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ABSTRACT 

The literature is reviewed that addresses the 
asnociation between background factors and educational outcomes. 
After completing the review, Westat, Inc. issued this report which 
synthesizes the literature into correlates of academic performance 
and outcomes other than academic achievement. The former considers 
such background variables as socioeconomic status, personal 
characteristics of students, school variables, attitudes, 
motivations, self-perception, aspirations, intentions, and 
expectations. The latter discusses the relation of background factors 
*o education, occupation, and income; considers socioeconomic status, 
ability, and attendance at college; looks at job experience as an 
outcome of education; and studies attitudes and motivations. 
Summariss of both sections appear, and a section detailing the 
report's conclusions and an epilogue describing the methodology used 
in relating background variables to outcomes are included. (SE) 



00 

^^ 

^ ABSOCIATIONS BETWEEN 

O EDUCATIONAL OUTCOMES 

UJ and 

BACKGROUND VARXABLEH: 



A Review of Selected Literature 



by 

Edward C. Bryant 

Ezra Glaser 
Morris H. Hansen 
Arthur Kirsch 

of 

Westat, Inc. 



Under contract to 

Education Commission of the States 
300 Lincoln Tower 
i/) Denver, Colorado 

(/> 



US DEPARTMENT OF HEALTH. 
EDUCATlON&WELFARE 
NATIONAL INSTITUTE OF 

0 EDUCATION 
tM.j DOCoS^E NT MAS 3EEN RE PRO 
^ Cv^CED EXACTLY AS RECEIVED P«OM 

Li *hE PERSON 0« OWOANiZATiON OJ*iGiN 

^ ATiNG.r PO'NTSOF ViEWOR OPINIONS 

S'A*ED DC NOT NfCCSSAR'LV REP«?E 
SEST orf^'CiAt. NATIONAL INSTITUTE Of^ 
FD'.CATiQS POSITION OR POLKV 



A Monograph of the National Assessment of Educational Progress 



erJc 



Thiii publication was proparod and produced 
purnuant to ayruomonts with tho National 
Center for Educational Statistici^ of tho U.S. 
Office of Kducatiun with additional fundB from 
tiio Carnecjie Corporation of Now York and tho 
Ford foundation's Tund for tho Advancement of 
Education. The statements and views expressed 
liorein do not necessarily reflect the position 
andpoiioyof the U.S. Office of Education or 
other grantors but are solely the responsi- 
bility of tho National Assessment of Educa- 
tional Progress I a px-ojoct the Education 
Conmussion of the States. 



National Assessment of Educational Progress, 1974 



Single copy $4 



Westati Inc. 
11600 Nebel Street 
Rockville, MD 20852 



National Assessment of 

Educational Progress 
SuLte 70 I 1860 Lincoln 
Denver, CO 80203 



TAHLfi OF COiNTENTS 



FOREWORD ^ 

PREFACE . 

Chapter Page 

1 INTRODUCTION 1 

1.1 Purpose of the Study 1 

1.2 Some Definitional Matters. ... 3 

1.3 A Note on Measurement of 
Association 6 

1.4 An Application of an Association 
Model to NAEP Exercises 14 

2 CORRELATES OF ACADEMIC PERFOWIANCF. . 21 

2.1 Overview 21 

2.2 Measures of Socioeconomic Status 
(SES) 22 

2.3 Personal Characteristics of 
Students 57 

2.4 School Variables 75 

2.5 Other Background Factors, Includ- 
ing Attitudes, Motivations, Self- 
Perception, Aspirations, 
Intentions, and Expectations . . 115 

2.6 Summary 131 

3 OUTCOMES OTHER THAN ACADEMIC 
ACHIEVEMENT I35 

3.1 Overview and Summary I35 

3.2 Relation of background factors 
to education, occupation, and 
income I39 

3.3 SFS, Ability, and Attendance 

at College I45 

3.4 Job Experience as an Outcome of 
Education I47 - 

3.5 Attitudes and Motivations. . . . 163 

3.6 Summary of Findings for Outcomes 
Other Than Achievement 177 



ERIC 



TABLE OF CONTiiJNTS (Continuea) 

Chapter Page 

4 CONCLUSIONS '^'^'^ 

4.1 Measures of SES 177 

4.2 Sex 180 

4.3 Race 180 

4.4 Ability 181 

4.5 School Factors 181 

4.6 Motivation, Attitude, Expecta- 
tion and Other Measures 181 

5 EPILOGUE 183 

5.1 Introduction ..... 183 

5.2 Methodology for Estimating 
Association 183 

5.3 Sources of Errors 187 

5.4 Limitations in the Interpretation 
of Relationships from Survey 

Data 188 

5.5 Unit of Observation and 

Analysis 190 

5.6 Large-Study Bias . 190 

5.7 Background Adjustment of Longitu- 
dinal Data 191 

5.8 Some Additional Comments and 
Recommendations Concerning 
Choices of Background Variables 

for NAEP 194 

5.9 Some Additional Suggestions for 
Research 19^ 

CITED REFERENCES ^01 



ERIC 



FOREWORD 



The purpose of the National Assessment of Educa- 
tional Progress xs to chart changes in American educa- 
tion by periodically measuring the knowledge, skills 
and attitudes of 9-year-olds, IS-year-olds , and 17- 
year-olds and young adults (26-35). In particular, 
N'ational Assessment estimates the proportion of in- 
dividuals who can respond acceptably to certain ques- 
tions or tasks (called exercises) in Science,, 
Mathematics, Reading, Literature, Writing, Citizen- 
ship, Social Studies, Art, Music and Career and 
Occupational Deve lopme nt , 

Traditionally, several variables — more accu- 
rately, "bundles" of variables that are proxies for 
each other have been associated with differences 
in educational achievement in this country. National 
Assessment analyses have employed several of these 
traditional variables in order to group respondents 
at each age level into subpopulations , These vari- 
ables include reaion of the country, sex, color, 
level of parents' education, and size and type of 
community. National Assessment reports present the 
percentages of people in each subpopulation performing 
acceptably on an exercise and they compare these group 
percentages to the percent of all persons in the age 
population performing acceptably. The difference 
between these two figures is called the group effect. 

For some time. National Assessment has been con- 
cerned that there may be other reporting variables that 
are better than these — that is, there may be more 
sensitive variables with fewer proxies. Some may be 
more easily and reliably measured; others may be more 
"durable" over time; some m.ay be more relevant to 
certain subject areas or ages; and others of greater 
use for interpretation and policy formation in the 
educational community . 

Another National Assessment concern is how to 
better understand and interpret group effects. One can 
perform ct^rtain statistical data adjustments to gain 
a better understandina of the facts obtained from 
our surveys. We have already employed one adjustment 
called "balancing." The fact that a group effect 
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reflects Northeast or Southeast reaional performances 
cioos not mean that these performances occur solely 
becaus^e the respondents live in the Northeast or 
Southeasrt. Since a larger fraction of respondents in 
large cities live in the Northeast than in the South- 
easti and since a larcfer fraction of respondents in 
rural areas lives in the Southeast than in the 
Northeast, regional differences may be masquerading as 
size and type of community effects. Balancing is 
intended to remove this masquerading and avoid double 
counting when making comparisons. 

Any adjustment procedure, however, is heavily 
dependent on the nature and number of variables 
included in the adjustment. The fact that proxy 
bundles for variables may change over time and that 
the representation of one group in another is also 
changing makes adjustment cf measures of change in 
performance even more complex. 

These and similar concerns led to the decision 
that National Assessment identify further variables 
useful in gaining a better understanding of differences 
in American education. Subsequently, a contract was 
let to Westat, Inc. to survey relevant papers and 
sources purporting to show relationships between back- 
ground variables and educational outcomes. 

The specific objective given to Westat in under- 
taking the literature search was to catalog past and 
current research into important background factors. 
The search was to include studies undertaken by 
scholars in disciplines other than education and in 
a variety of contexts other than the school. Further, 
the Westat report wa^ to describe the methods used by 
various researchers to identify, delineate and mea- 
sure background variables. 

In adlition to this informatiun about important 
studies, National Assessment asked for a bibliography 
of studies identified by Westat 's literature search 
but not critiqupd and detailed. Such a bibliography 
would be useful not only to National Assessment but 
to other users of this background factors study who 
may wish to initiate further research. 
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With this background factors study, Westat has 
concluded the first of many important steps toward 
the possible adoption of new and more useful variables 
for National Assessment analyses and reports. 



Roger Talle 
Robert Larson 
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PREFACE 



This report was prepared under contract to the 
Education Commission of the States and was supervised 
by Dr. Roger Talle, Director of Operations for the 
National Assessment of Educational Progress (NAEP) . 
The purposes of the contract are identified in an 
"Introduction to Background Variables Report" which 
follows this Preface, 

This report has a strong statistical flavor. As 
a consequencje, there is a minimum of interpretation 
of the results in terms of educational policy, al- 
though the relevance to educational policy of the 
investigated relationships is obvious. We have pur- 
posely chosen to let others draw such policy rele- 
vance from the conclusions reported. 

It would not be feasible for us to acknowledge 
here all of the persons who contributed to the com- 
pletion of this report. A nam.e that must be mentioned, 
however, is that of Dr. Tors ten Husen, Chairman of the 
International Project for the Evaluation of Educa- 
tional Achievement, who provided invaluable advice 
in the planning stages of the project. Another major 
contribution was that of James Gold and Gordon Hanson, 
compilers of Correlates of Achievement , a helpful 
draft bibliography. Dr. Carl Feigenbaum of the 
Westat staff contributed to the project in a major 
way by his painstaking review and screening of many 
of the items included in our biblioaraphy (separately 
bound ) . 

As a part of the project, we invited the parti- 
cipation of a number of educators, representatives of 
state education departments, educational researchers, 
and oovernm.ent officials. The preliminary draft was 
submitted to them, and a two-day critique session was 
held at the Rockville offices of Westat on December 
5-6, 1973, with approximately half of the participants 
at each day's session. The participants and their 
affiliations are listed on the following pages. 
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CHAPTER 1 
INTR015UCVI0N 



1.1 Purpose of the Study 

Within the past ten years substantial intere ,z 
has developed in the measuren^ont of educational otv:- 
comes and their relation to various inputs. Some of 
the interest has scemmed from the desire to evaluate 
the effectiveness of educational processes, both vith 
regard to particular strateaies and also with rc:ard 
to the total milieu within which education take^:> 
place. The National Assessment of Educational prog- 
ress (MAFP) is a long-range project of this kin J, A 
special interest in educational outcouies has k<en 
generated by concern about equality of educational 
opportunity for specific minority groups. At one 
extreme of this concern is the philosophy th;>r: equal- 
ity of educational opportunity is evidenced .^y equal- 
ity of educational outcomes. A less extrem^:.^ view is 
concerned with improving educational strate:. ies and 
recognizes the importance of the measuretier.-; of out- 
comes in vhe evaluation of alternatives » 

Tt also has been observed that measv-res of 
educational outcomes vary, not only by th^ educational 
process applied to the pupils, but also hy the socio- 
economic backgrounds and other characteristics of the 
pupils their family composition, the income and 
educational attainment of their parents, and so on 
as well as by the ability of the pupils. This recog- 
nition has led to the use of backgrourd measures to 
adjust outcoi^e measures (by statistic^zl procedures) in 
order to permit more sensitive comparison of outcomes 
where such outcomes are intended to jeflect effects 
of educational processes or of effor ts to ew7uali2e 
educational opportunity. 

NAEP is doubly interested in ^idjustment for 
background factors. First, it is .interested in compar- 
ing the outcoines of subgroups of tne population. The 
absolute differences of those subcroups are of in- 
terest to educators, sociologists, a/id government 
pxanners because they represent tne gross sum of all 
influences on the population subgroups, and gross 
differences iray provide sufficie'^t evidence of the 



1 



ERIC 



nooU tor urcuranwatio action • But educators and 
cthors are also int<:^rested in subgroup differences, 
not of ditferonces in background, as a way to measure 
the effectiveness of the educational process* An 
example of this use of data adjustment is provided 
by N\M:P's Report 7 for the 1969-70 assessment Vsihich 
provides "balanced" results for science. 

Second, by its name, NAEP is interested in 
measuring the vycay&di' of education, im.plying com- 
parisons over time. Thus, it is important to adjust 
apparent differences over time for differences in 
backgrounds that are known to have an impact on educa- 
tional outcom.es. Otherv\'ise, apparent changes over 
tim.e could be accounted for by a changing composition 
of the sample, which may reflect a change in the com- 
position of the population as well. 

In this report we have examined some of the 
principal literature which shows association between 
background factors and measures educational 
outcom.e. We have not attempted to examine all such 
literature. An extensive bibliography containing 
several hundred items is included as an appendix to 
this report and is bound separately. Out of those 
items we have selected some which appear to contain 
the principal conclusions that are portrayed by the 
larger set. Other researchers might have chosen a 
different set and, indeed, the bibliography might 
easily have been doubled or tripled in size by de- 
voting more time to the search. Some of the princi- 
pal papers cited in tnis report have been abstracted 
and the abstracts have been included in the 
bibliography . 

One of the findings of nearly all researchers 
in the field is that background factors are hiahly 
intercorrelated . Education ol parents is correlated 
with occupations of parents and both are correlated 
with family income. If one adjusts outcome measures 
for differences in educational attainment of parents 
he will also adjust for much of the difference in 
occupation (or income). Thus, there is a great 
potential for substitution among the background 
variables m.easured. We have only incidentally noted 
presumed difficulty or ease of measurement of back- 
ground variables, although this characteristic would 
certainly be considered in choice of variables in any 
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revision of the MAEP data-collection plan, inter- 
cort-Glations amonq variables are important, of course, 
to the feasibility of selecting variables at least 
partly on the basis of ease in collection. 

OutcoiPe variables are also correlated, and the 
literature is filled with research on testing that 
0.10WS relationships arona measures of academic per- 
rormance, attitudes, aspirations, job performance, 
ana so on. we have not given much attention to such 
correlations in this report. Instead, we have or- 
ganij?ed the report by principal classes of outcome 
measures. Chapter 2 discusses academic achievement 
scores and related kinds of outcome measures and the 
relationship of these to various types of background 
variables. Socioeconomic background variables are 
discussed first, followed by personal characteristics 
and family relationships, then by school variables 
and finally by attitudes, motivations, self-percep- 
tion, self-esteem, external control, aspirations, 
intentions and expectations, where this last group of 
variables is considered as background for achievement 
rather than outcome of the educational process. 
Chapter 3 discusses other outcomes briefly, such as 
attitudes, social participation, college attendance, 
and so on. Chapter 4 summarizes the principal findings 
and Chapter 5 presents some of the staff's views on 
related topics. 

In the remainder of Chapter 1 we briefly discuss 
some definitions and methodology that affect the in- 
terpretation of the findings presented in Chapters 2 
and 3 . 



1.2 Some Definitional Matters 

The purpose of this study is to review the 
principal literature that addresses the association 
between background factors and educational outcomes. 
The intended use of the study is to provide the basis 
for decisions concerning the kinds of backaround data 
to be obtained from pupils, teachers, school adminis- 
trators, and other sources relating to assessment 
and analysis of educational proaress. The technique 
used is to identify the fraction of the variability 
of a m.easure of outcome that can be associated with 
variability in the background variables, jointly or 
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separately, and thereby to help explain the variabil- 
ity in the outcome measures. The principal outcomes 
of* interest are the outcomes measured by the National 
Assessment. These consist primarily of answers to 
exercises, the percent of answers of a given kind by 
a ctiven population subaroup being a measure of accumu- 
lated knowledge, skill, or attitude of the subgroup. 
It can be anticipated that performance on such a set 
of exercises will be correlated with performance on 
more traditional kinds of educational tests. 

The term "educational outcomes" is not intended 
to ir.ply that the outcome is the result of only tho 
fornal educational process. Knowledge, skills, and 
attitudes are influenced by numerous other factors, 
some of which are measurable or correlated with things 
that are iP.easurable but many of which cannot be cali- 
brated in any reasonably adequate manner. 

The measurement of outcomes and their comparison 
over tine may permit one to "assess" educational 
progress (where "education" is broadly construed to 
include informal processes), but without additional 
information they are of limited use for analytical 
purposes. For interpretation one also wants to know 
how effective the total educational process has been, 
both nationally and for specified subqroups , after 
allowance for differences that tend to handicap or 
give advantage to specified subgroups of interest. 
This analytical requirement provides an important 
motivation for collecting background variables. 

Some background factors are relatively stable, 
such as the occupation and education of parents, and 
are not influenced by the educational process. It 
is helpful in evaluating the educational process to 
distinguish these from others that may be controlled 
or changed. The key assumption is that, for the 
short term, some background variables may be consid- 
ered fixed, and these", especially, may be regarded 
as not subject to the control of the educational^ 
process. A simplified model has been displayed in 
Figure 1. The arrows may be interpreted to symbolize 
the words "has an influence on." The model follows 
in a general way the "path coefficient" models of 
Duncan, et al. (11) 
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For those purposes we have assured that a mea- 
sure of ability is a relatively stable background 
factor. For analytical purposes it may be desirable 
to isolate it fror other background variables. It is 
assured that ability is not influenced by the educct- 
tional process (although there is arple evidence that 
the "r.Jc^u^t^'^o V : of ability may be). 

Note particularly, however, that motivations, 
expectations I aspirations, and other attitudes may 
be* influenced both by the educational process and by 
r.ore stable backarcund factors, and in turn, exert 
an influence on outcom.es. Thus, they may be considered 
;i. 7 variables. For some purposes it is de- 

sirable to consider them, as outputs and for others 
to consider them as inputs. In order to keep this 
study within m.anaceable size we have deemphasized 
interm.ediate variables and have generally studied 
reported associations between more stable background 
factors and perform.ance . 



1.3 A Note on Measurement of Association 

Suppose we consider a simple (but hypothetical) 
exar.ple in which the outcome is test score on a 
twelf th-grade science test and the background vari- 
ables are race and sex. We assume that such a large 
sample of twelfth-grade students has been tested that 
we need not be concerned about sampling error. 
Suppose the averages are as follows (the data are 
hypothetical ) ; 

Race 



Sex White All other All Races 



Male 64 56 6 3 

Female 60 52 59 

Both sexes 62 54 61 



There are obvious differences in the average perform- 
ance of the sexes and the two categories of race, 
because they vary from the over-all averaae score 
of 61. 
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If a male white student achieves a score of 
70, one can identify 70-61, or 9 score points, as the 
arount of his total variation froir the mean of 61. 
Of that total variation of 9 points, three points 
(64-61) are "explained" by the fact that he is a 
v/hite rale, and the remainder (6 points) is unex- 
plained by tiie sex-race classification. 

The above example is an illustration of a means 
of explair.ina some of the sources of variation in an 
individual student's score. A way is needed to sum- 
marise such variation over all students. Because of 
properties that need not be discussed here, sums of 
squares of difference are used. It can be shown that: 

A. T!ie sum of the squared differences between 
individual-student scores and the overall 
mean is equal to: 

B. The sum of the squared differences between 
the individual scores and the individual 
cell (sex by race) means, plus 

C. The sum of the squared differences between 
the cell means and the over-all mean {summed 
over all students) . 

The ratio (C/A) is the proportion of variance ex- 
plained by the backaround variables — in the above 
illustration, by sex and race. 

In the real world one does not have test scores 
for all students in the universe, so there is sam- 
pling error in the errtimation of the means. Also, 
even if he had scores for everyone, there would be 
measurement error that would tend to distort the 
r.eans. Such sampling and measurement errors tend 
to make estimation of the proportion of explained 
variance less precise, but the additive relationship 
given above still holds. 

Note that "explained" does not connote cause 
and effect, only association. Also, it may be that 
race (for example) is strongly associated with income 
and other factors, and these factors might have ex- 
plained more variance than race if they had been used. 
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The introduction of many background variables 
together with relatively small samples makes the 
simple analysis illustrated above infeasible — there 
are too many groups (cells in the table), and some of 
them may have no cases in them. Two procedures are 
commonly used to approxim.ate the above type of 
analysis. First, multiple linear regression methods 
are employed to estimate the proportion accounted for 
by the backctrovnd factors. That is, in the above 
illustration, one could set up the following linear 
m.odel ; 

y. = Sk,. + Rx^. + IXt-x . + e. (i = 1, 2 ...n) 

^1 ll 2l 11 21 1 

where 

n = the total number of students, 
X, =1 if male, 0 if fem.ale 
xi = 1 if white, 0 if nonwhite 
y^ = score in science 
S = effect of sex 
R = effect of race 

I = interaction effect of race and sex 
e = unexplained variation 

In the above example S and R are marginal 
t,-;V*'^:?:c^ and I is an interaction. In this simple case, 
solving for S, R and I by least squares methods and 
using those results to estimate the proportion of 
variance explained by sex and race would yield the 
identical results obtained by examining the cell 
means, above . ^ The equivalence will not be shown ^ 
here. An important feature of linear regression is 
that it is extendable to many variables. However, if 
there were three marginal effects one could have three 
simple interactions (among two factors) and one three- 
factor interaction. The number of interactions ex- 
pands rapidly with increasing numbers of factors and 
an almost universal practice is to assume higher- 
ordered interactions (among three or more factors) 
are zero and hence are not to be computed. Also 
variables that are found not to have an important 
effect, or that essentially duplicate the effects of 
other variables, are eliminated. The result is a 



^ This is not true, in general, for tables with more 
than four cells. 
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sinplif ication that pemits oug to estiinate the pro- 
portion of variation ex::lained by a large number of 
variables • 

The second procedure commonly used to redu<5e 
the number of variables (or the number of groups for 
which effects are to be computer^) is to construct 
composites of variables For exc;mple, Thorndike 

(48, pp. 72ff), in his analysis of reading-comprehen- 
sion scores in the U.S. portion of the international 
assessment, used ten categories for father's 
occupation. These ten classes were used as variables 
in a regression analysis, each receiving a value of 
one for the cateaory in which father's occupation 
fell and zero otherwise. The criterion variable 

(dependent variable) was reading-comprehension score 
for the 14-year-old population. The rearession 
analysis automatically assigned weights to each 
occupational category and thus collapsed the ten 
categories into a single score for father's 
occupation. Scales were also developed for father's 
educational attainment and m.other's educational 
attainm.ent. The three scales were put into a single 
composite measure of SFL?, usina similar procedures. 
The method is quite general and has been used exten- 
sively by analysts of educational test scores. A 
procedure such as that just described would lead to 
a different weighted average, or composite, for each 
dependent variable — e.a., one composite measure for 
reading and another for mathematics scores. A common 
procedure, however, is to define a single composite 
to be used with a num.ber of dependent variables being 
analyzed . 

Another method of forming composite scales is 
to use factor-analytic methods and to identify the 
principal factors by the nature of the individual 
scores that comprise them. The method will not be 
discussed here. 

There is still another kind of compositing or 
averagina that has a major effect on the amount of 
explained variance. Som.etimes the student is the 
unit of analysis, anr* soneLim.es the school i^ the 
unit of analysis. In Lh.^ former case one is inter- 
ested in deterrinina zi ^- f variation in 
student outcome m.ea?"- ^plained by background 
variables, and in t:.^ idtter case one is interested 
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in detern^ining the percent of variation in avei^a:^'e 
i^jh^:! ^'JC!'t:i^ accounted for by background variables 
.r/t-r The percent explained 

when the school is the unit of analysis is generally 
hiciher than when the student is the unit of analysis. 
An example of the importance of the unit of analysis 
in estimating percent of variance explained is pro- 
vided by Comber, et al. (7) with respect to the U,S, 
scores on the International Studies in Science 
Education. Four composites of background factors 
wpre constructed by methods similar to those de- 
scribed above. The following data represent per- 
centages of variance explained for 14-year-old 
students . 

Additional percent explained 



Composite variable School as unit Student as unit 



SES, sex 


67 


22 


Type of school 


0 


2 


Learning conditions 


11 


7 


Kindred variables 


1 


6 


Total 


79 


36 



The total percentage explained is approximately 
half as great for students as for schools, and SES 
serves as a much more effective explanation of dif- 
ferences in averaae school scores than of differences 
in student scores. These results are not atypical. 
Note that variance of student scores is across all 
schools and not variance within schools. . 

Display of the components of total sum of 
squares (of individual student scores from their 
overall mean) helps one to understand the difference 
between variance explained by regression on school 
m.eans anc variance explained by regression on indi- 
vidual student scores. Consider the following sources 
of variation: 

Source of variation Sum of Square 



Due to differences in school means 
Due to regression on school means 



A 

^1 



Source of variation 



£ui^ of Square 



Residual from regression on school 
iTieans 

Due to differences ar.onci students 

within schools B 
Oue to coTr.inon i.-eqression on student 

scores within schools 
Residual from coinnion regression 

within schools B. 



'1 
'2 



Total sur. of sauares 



The above display assumes that there are two 
regressions; one on school means and the other on 
student scores within schools. Although this kind 
of analysis would be helpful in determining the im- 
pact of certain background variables, it has not been 
widely used. A corjronly used anai^sis is the 
followina : 



Source of variation Sum of Square 

Due to regression on student scores, 

ignoring school differences C, 

Residual from student regression ci 

Total sum of scuares C 



The percent of variation explained by regres- 
sion on :.K.: : V ' lual .-^^'^dcKt scares, ignoring differ- 
ences among schools, is lOOCj^/C. The percent of 
variation explained by regression on sohocl rneans 
(from the previous model) is lOOAj^/A. 

The differences in magnitude of the percents of 
explained variance can be analyzed in the following 
way . 
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0 

Let = the proportion of variance among school 

means of achievement scores accounted 
for by regression on the school means of 
the regressor variables = A^^/A. 

w = the proportion of variance within schools 
accounted for by regression on the indi- 
vidual student regressor variables after 
subtraction of the school means = B^/B. 

p = proportion of total student variation in 
achievement scores that lies between 
school means = A/C, 

2 

R, = the proportion of total student achieve- 
^ ment variance accounted for by the two 
regressions (one on school means and one 
on student characteristics after sub- 
traction of school means) = (A^ + B^)/Cm 

2 

R = the proportion of total student achieve- 
ment variance accounted for by a single 
regression (ignoring differences among 
school means) = C^/C. 



Then, 

2 2 . ^2 

+ w = P \ (1 - 

2 

We have seen that Rj^ is typically an overestimate of 
R^. Ordinarily, R^> + ^> • ^ the NAEP applica- 
tions one would like to know R^ , which is derived from 

a single regression equation. It tends to be only 

2 2 
slightly smaller than Rj^ ^ ^, but Rj^, the variance 

explained by regression on school means, tends to be 

2 

substantially higher than R . 

An important but often ignored characteristic 
of : agression and correlation studies is that the 
independent variables chosen for the regression are 
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these that show high correlation in the particular 
sa:r.p.le observed. Son^.e of this apparent hicfh cor- 
relation is the consequence of that particular 
sapple — sore variables would have hioher and soir.e 
lower correlations with the criterion in another 
sar.ple of siirilar size and design. Unless the saipples 
are very large, this choice of variables to include 
in the regression equation will tend to overstate the 
"true" correlations and the "true" explained variance, 
A conputation of the sane correlation (based on the 
sar.e independent variables) in an independently se- 
lected sample typically would yield a lower and rpore 
valid estirate of the correlation. Thus, re<?ression 
and correlation corputations tend to result in over- 
staterents of the arount of explained variance. An 
illustration of this is given in a California State 
pepartrent of Fducation study (4). After a set of 
independent variables was selected through step-wise 
regression, correlations were estimated fror. each of 
a set of dependent variables. The median squared 
p.ultiple correlation coefficient was approxiinately 
0.50. However, a separate sample had been withheld 
fror the analysis employed in choosina the independent 
variables. Khen the correlation was estimated from 
this independent sample, the median squared multiple 
correlation coefficient was reduced to appro:;imately 
0.40. Ordinarily, no such independent sample is with- 
held for evaluation and estim.ation. Indeed, for this 
reason, :rast of the analyses included in this report 
can be reaardec as overestimates of correlations or of 
explained variance. The magnitude of the problem is 
a function of the size of the sample — with quite 
large samples there is less dancer of substantial 
overestimation . in the California study, school 
districts were the unit of analysis, and the regres- 
sion estimates involved the selection of 11 indepen- 
dent variables for use in a rearession equation from 
a set of 22 that were examined. 

Another important characteristic of regression 
and correlacion studies is that, as variables are 
acMed to a regression equation, it is commion to show 
the increase in the m^ultiple correlation as a result 
of the added variable, and the increase in the amount 
of variance accounted for. Thus, the added amount of 
variance accounted for by a variable is a function of 
the order in which it is introduced and of the other 
variables that have been introduced. A different 
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order incT of the variables rray assign then quite 
<aft'erent proportions of variance accounted for. 
Ti'o effects of this are observed in many of the 
studios we Viuve exa.'^ined. It is con\r>on, for example, 
to introduce a measure of SVS early, and consequently 
this will account for a higher proportion of the 
variance than if school variables were introduced and 
the socioeconomic-status variable later. Unless 
proper account is taken of this some of the results 
cited will appear contradictory when they may not bo. 

One m.crs aeneral corpent is approp^^iate . The 
efr:rv5 to adjust for various measures can be effec- 
tiv-v^ only to the extent that tho measures for which 
adjustment is being made are themselves reasonably 
accurate measures. The effectiveness of adjustments 
is reduced when independent variables which are them- 
selves subject to substantial errors of measurement 
are U5=ed for adjustment. The practical consequence 
is that adjustm.ent for variables like sex will not be 
sianif icantly impaired by errors of measurement, but 
a;!justments for socioeconomic status, or measures of 
ability, or other variables that are subject to sub- 
stantial errors of measurem.ent may be impaired. 



1.4 An Application of an Association Model to NAEP 
Kxercises 

NAFP adm.inisters exercises to 9, 13, and 17-year 
olds and to youna adults. While the exercises are 
Grouped accordinq to subject matter into packages 
for administrcition , agaregate test scores are not 
computed for individuals. The exercise itself is the 
focus tor analytical attention and agareaation is 
accor.pl ished for a sinale exercise across all students 
by corputina "P values," i.e., the proportion of all 
answers fallinq into a given cateaory. Usually it is 
possible tc identify one of the response cateaories 
as correct. Tn such cases the P value for that re- 
sronse category is the percent of students responding 
correctly. Tn sore cases, such as in attitude ex- 
ercises , there is not a correct cateaory. In those 
cases the P values for all of the response categories 
7\ u St he e M 3 r. i n e d together. 
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In order to focus attention more sharply on what 
ir.uant by "association" and "data adjustment" we 
consider the ir,<;dels given below. For convenience, we 
consider the case in which there is an identified 
correct response to the exercise. Then, for the e^^ 
exercise, tm. j^^ member of the i^^ population sub- 
group will achieve a score of 1 if he answers cor- 
rectly or 0 if incorrectly, which we will designate 
by the variable y^^^j. This variable is the outcome 
measure fcr the jth member of the i^^ subaroup at- 
tempting the e^^ exercise. V7e presume that this 
outcome i.s a function of background effects (which 
may be <iiffurent for each exercise and for each 
subgroup) and unexplained factors, so that we may 
specify : 



where F^^^^ is a set of family background characteris- 
tics associated with the correctness of response to 
t:*u e exercise by the j^^ member of the i^^ sub- 
'jroup, Ig^j is a set of individual student charac- 
teristics such as sex, ability and motivation, S . . 

ex] 

IS a set of school characteristics (including charac- 
teristics of the copjrunity in which the school is 
located). The component E^^^ is an unexplained com- 
ponent of the response which includes response error, 
failure to include explanatory variables, and random 
error. The functional form of f^ is unspecified, but 
in actual practice a linear model has usually been 
presumed. Also, in practice, the motivational and 
attitudinal characteristics are frequently included 
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in the tern; K .^i rather than in If one aver- 

th 

ages actual responses over the i subgroup for the 
exercise I he obtains P values. 

Coirputationally , f^ is often considered to be a 
linear function of family, individual and school 
characteristics. In a simple case, one could con- 
struct three indices of background factors: one for 
family characteristics, one for individual charac- 
teristics, and one for school characteristics. If 
only one index is used for an F-type characteristic, 
one for an I-type characteristic, and one for an S- 
type, a simplified model could be expressed as: 

p . . = b^ + b, F. . + b^ I - * . 
^eij Oe le i] 2e i] 3e 13 

where p . . can be reaarded as a regression estimate 

®i] . th 

of the probability that individual j in the 1 group 

*% 

will answer exercise e correctly^ It will be a close 
estimate if the multiple correlation coefficient is 
near unity. Obviously, the model can be expanded to 
include cross-products of the indices or to include 
individual variables for each of the three types and 
transformations of thetn. 

Usina the simplified model, above, the total sum 
of squares over all subgroups for exercise e can be 
expressed as: 

Total SS = 1' (y^. j - Pg)^ 
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where y . . is the actual score (zero or one) and P 

J .e 

is the average over all i and j. The sum of squares 
accounted for by the indices F, I and S can be ex- 
pressed as: 

SS Accounted for - Z (p . . - P ) 
(by F, I and S) i,j ® 



Then, the proportion of the total variation in indi- 
vidual exercise responses accounted for by the re- 
gression model is 

_ Accounted for SS 
Total SS 

and this is the square of the multiple correlation 
coefficient • 

To illustrate the adjustment of data with the 
above procedure for a particular exercise, e, let 
i = 1, 2 designate two subgroups, black and other, for 
which comparisons are to be made, and j the individual 
student taking the exercise within the i group. 
Suppose that F^^ is a composite measure that represents 
the socioeconomic status based on a composite measure 
of social status of the family of student ij. For 
illustration, F^j might take on values as follows: 

1 = high measure of socioeconomic status 

2 = middle measure of socioeconomic status 

3 = low measure of socioeconom.ic status 
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Let I^.. be assigned the values 0 or 1 depending on 
whether the student designated by ij is male or female, 
respectively, and let S^j represent the average ex- 
penditures per pupil in the school attended by student 
ij. The observed score on a particular exercise for 
group i is: 

•^ei = f ^'eij/^i 

and the score that would be produced from the model 
if one assures a "comanon regression" across all sub- 
groups is: 

p'. = b^ + b, F. + b- I. b,^ S. 
^ei Oe le 1 2e i 3e i 

where F.# I. ^nd S. are averaqes of the background 

^ .th^ 
scores for the i group. 

Let F, I and S represent average background 
scores for all students taking exercise e. Then, an 
adjusted P value for group i is: 

hi = Pei ^ he - h^ ^ he ' ^' 
- (S - S.) 

Th: s adjusted score will, tc the extent that the 
'T.:.-; :r r :* Vt: :r ^icing so, remove the effects 

of differences among the subgroups for the variable 
used in the model? i.e., it will remove the effects 
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of differonces in proportions in different socio- 
econoric classes, the differences in the proportions 
of each so:<^ and th^e differences in the levels of 
expenditures per student. 

There is an assuirption in the model that the 
regression on the background characteristics is the 
sare for all subaroups of interest. This as5?.umption 
frequently is not true. Tor exan^ple the reqression 
of performance on SFS may be different for black 
children than for white children. In such cases, if 
one wishes to compare black children with white 
children the following adjustrrent procedures are 
soretimes employed: 

I. Compute the regression of white outcome on 
white SES, and arrive at SFS-ad justed P 
values . 



2. Apply those rearession coefficients to the 
black background m.easures and arrive at 
SFS-adjusted P values for black children. 

3. Compare the adjusted P values, 

This procedure essentially matches that employed by 
Duncan, et al. (11) . The risks in such adjustments 
are evident. The rearessions are likely to be 
different in the two groups so that, if the whites 
were adjusted by the black rearession, a different 
comparison would be obtained. 

Another approach is to adjust each group by its 
within-group regression, as follows: 

Pei = Pel * ^lei " * ^2ei " ^i^ 

* ^3ei - S.) 

That is, a separate regression adjustment miaht be 
m.ade for each group of interest, and the adjusted 
scores can then be compared. 

Another adjustm.ent follows the procedure, used 
in demographic computations, of computina adjusted 
rates. Mushkin (38) sugaests three methods of ad- 
justment, based upon weighting to population values, 
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that are essontially of this forni. There are, of 
course, other adjustir.ent procedures • The one^ we have 
described are corron ones. The one used by NAKP in 
Report 1, which balances science-exercise P values, 
is less comiron. 
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CHAPTER 2 



CORRELATES OF ACADEMIC PPRFORimTE 



2.1 Overview 

This chapter discusses the relationships that 
have been examined in the literature between back- 
ground factors and measures of academic performance. 
NAFP's measure of outcome is a response to an exer- 
cise which is designed to measure knowledge, skill or 
attitude with respect to an educational objective. 
The outcomes in this chapter can most easily be 
identified with "knowledge." 

Most of the literature we have examined con- 
siders outcomes in the form of test scores rather 
than responses to individual exercises (as in NAEP) , 
but the assumption that the association with back- 
ground factors would be similar seems reasonable. 
Also, some of the most complete analyses of associa- 
tions with background variables have used measures of 
ability, rather than performance, as the criterion. 
We have used some of these studies to show associa- 
tions under the assumption that many such ability 
measures are highly correlated with performance and 
many, in fact, have strong components of accumulated 
knowledge in them. 

In Section 2.2 of this chapter we discuss the 
association between socioeconomic status (SES) and 
outcomes. SES is reasonably independent in the short 
run of school influences. 

In Section 2 . 3 we discuss the association be- 
tween outcomes and personal characteristics, family 
structure, student-parent relationships and measures 
of ability. In particular, we have looked for re- 
search papers that have distinguished the added 
amount of association due to ability over the associa- 
tion due to ho^e background and other personal charac- 
teristics. Note that in Section 2.2 we sometimes use 
ability as a proxy for academic perf orm.ance , but in 
Section 2.3 we consider indivrdual ability as a back- 
ground variable. 
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Section 2,4 considers school v^ariablcs as back- 
ground in the explanation of academic performance. 
We are prinarily interested in determining how much 
impact school characteristics have on individual 
performaiice . Unfortunately, much of the literature 
deals with the predictability of aver^a^c 3'?ru?c2 cut^ 

from school variables, includina r.vcrjgc student 
; . j>.zyj,c»': ev\ \ 3s . It has not been posisible to 
unravel most of the published figures in a way that 
would be optimally useful to NAEP. 

Section 2.5 considers the impact of other back- 
ground factors on educational performance. Variables 
considered are attitudes, motivations, self-perception 
aspirations, intentions, expectations, and other 
factors. They frequently have been called "inter-- 
mediate" variables since for some purposes they are 
an output of the educational system and for other 
purposes they are an input. We consider them as in- 
puts in Chapter 2 and as outputs in Chapter 3. 



2.2 Measures of Socioeconomic Status (SFS) 

One set of background factors that is shown by 
nearly every study of background to have relatively 
high association with measures of school performance 
is socioeconomic status. This generalization holds 
over a wide ranar of outcome measures and over a 
variety of ways in which SFS is measured. It also 
holds for both the performance of schools and for the 
performance of ird^^ v lJ.\Ka' s \'ithin echoclii. Therefore, 
we have chosen to begin our discussion of background 
with variables that measure SES and to presum.e for 
subsequent analysis that some measure of SES will be 
included in any measure of background. 

One is immediately faced with the reality that 
the various measures of SES, as well as various 
outcome measures, are nontrivially correlated. That 
is, if r.easures of SFS are associated with scores in 
arithretic they are likely also to be correlated with 
scores in readina, in languages, in measures of abil- 
ity and a wide assortment of affective measures. 
Also, various pleasures of SFS, such as fam.ily income, 
parental education, occupation of household head, 
rental value, readina materials in the home and 
appliances in the hom.e are highly intercorrelated . 
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Consequently, using a single carefully chosen 
measure of SHS, such as family income or occupation 
ot head of household, may "explain" a larqe proper Lion 
of the variance associated v;ith measures of SEE, and 
adcmg additional meuiJures will produce smaller and 
smaller increments of explained variance. Furthermore 
this generalization is reasonably invariant for most 
academic outcomes. There is less stability over the 
various affective measures, but even there a substan- 
tial amount of invariance exists. 

Since there is extensive evidence of the impor- 
tance of SES to educational outcomes we will accept 
the need for its measurement. The thrust of this part 
of the present study will be to examine association 
between composite measures of SFS and educational per- 
formance and then to investigate the components of 
various SES measures. 

Although some studies have included race or 
national origin in SES, we assume, because there has 
been so much interest in recent years in equalizing 
educational opportunity, that race or ethnic-group 
membership will be recorded as a separate item and 
not be included in a jom.posite measure of SES. In 
this study race or ethnicity are separated from 
measures of SES. 

It seems clear that a measure of family income 
or a proxy for it should be included in a socioeco- 
nomic measure. Commonly used proxies are occupation 
of father (and sometimes the mother) and items in 
the home. Measures of social status freauently have 
been defined in terms of personal and family charac- 
teristics which in some way are presumed to have an 
association (not necessarily causative) with educa- 
tional outcomes. One such measure is education of 
parents, although the correlations of this item with 
occupation of head of household (and with income) are 
quite high. A number of studies have tended to build 
social status into a classification of occupations 
(e.g., 27, pp. 19ff) rather than simply economic 
level. The NORC study (Reiss (47)) made a pioneering 
effort to associate "general standing" with a wide 
range of occupations. 
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It is cor.r':on for socioeconomic scales to include 
measures that are? proxies for the attitude of the 
fatvily toward intellectual activities. These measur^^s 
frequently include subscription to a daily newspaper, 
nurber o*"^ books and TPaqazines in the home, and whether 
the hor.e contains a dictionary or encyclopedia. 
Another farily characteristic which soretimes is 
found in ?FS scales is whether the family is intact, 
i.e., both parents present and, if not, sometimes a 
distinct ion' is made as to whether the family is broken 
because of death or for other reasons. 

While they are not necessarily included in SES, 
some investinators have used number of children and 
position of the child in the hirth order, as well as 
reliaious preference, political preference, and other 
variables. Since we cannot reanalyze the data in the 
studios we have examined, we must report the results 
as given in those studies. V7e do attempt , however , to 
be quite specific concerning the construction of the 
SF.S scales when such structure can be determined from 
the study itself. 

We proceed first to discuss the aaoregate amount 
of associatioii that various researchers have found 
between SES and educational outcomes without adjust- 
ment for other factors. This discussion will not pay 
much attention to the composition of the SES measures. 
Later v;e will present the major findings with respect 
to specific measures of SFS and the construction of 
scales from, questionnaire data. 



2.2.1 Composite Measures of SF? 

In this subsection we report some findings v;ith 
respect to the association between measures of SES 
and' '/arious measures of educational outcomes without 
renard to the specific composition of the SES measures. 
The objective is to establish, if feasible, an amount 
of association that can reasonably be expected to be 
shown between SFS and outcomes. The subsections 
following this one will investigate the literature 
with respect to the m.easurement of SFS. 

Project TALEMT (14) used data from student in- 
formation sheets for a national sample of about 2,900 
tv;el f th-arade rales concernincr 25 item.s reflecting 
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socioeconomic status. The items reflected o<?ouvaticfii 
father's occupation, number of people supervised, 
r«ispcnsibilitiesi business and professional associa- 
tions; iKj.^^c: far.ily incom.e and finances, rent (or 
value) of home, number of rooms; oultural educfa- 

v books, news maaazines, culture magazines, 

literary maqazines, cultural equipment, father's 
education, mother's education, student has own room; 
.^':r->' 'rr--.? ■:>: h-v^^: number of appliances, TV, radio, 
etc., luxury items, sports equipment, number of hand 
tools, numi:)er of power tools, number of cars, and year 
of car. These items were correlated with 14 measures 
of ability, and the percent of variation in each test 
accounted for by the socioeconomic variables is shown 
in Table 1. 

Table 1. Squared multiple correlations between en- 
vironment and various measures of ability, 
subsample of Project TALENT (twelfth-grade 
males, student is the unit of analysis) 



Dependent Variable — P^bilities 


Squared 
Multiple 
Correlation 


Information, Part II 


0.28 


Information, Part I 


0.27 


Reading Comprehension 


0.23 


Math Total 


0.21 


English Total 


0 .19 


Mechanical Reasoning 


0.17 


Abstract Reasoning 


0 .15 


Creativity 


0.14 


Kord Functions 


0 .14 


Disguised Words 


0.12 


Visualization in Three Dimensions 


0.11 


Arithmetic Computation 


0.10 


Memory for Words 


0.06 


Visualization in Two Dimensions 


0.06 



Source: Project TALEJ.'T : One-Year Followup Studies 
(14, p. E-8) 
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It is intcrestinq to observe that about 27-28 
percent of the variation in the inforniation-test com- 
ponents (correspondinq roughly to accumulated knowl- 
edae) is accounted for by measures of SES and that 
this percentage declines as the test components be- 
come more nearly abstract measures of ability. 

Bachman et al. in Youth in Transition (1) used 
many of the same measures of socioeconomic status as 
the* Project TALENT socioeconomic variables in a 
national sample of 2,213 tenth-arade boys. About 19 
percent of the variation in individual-student scores 
on the Quick Test of Intelligence was explained by 
the socioeconomic variables (1, Vol. II, p. 50). 
These variables were: 

• Father's occupational status (coded by Duncan's 
scheme (11) ) 

• Father's education (five scaled classes) 

• Mother's education (five scaled classes) 

• Possessions in the home (13 items) 

• Number of books in the home (six classes) 

• Num':)er of rooms per person in the home 

The overlap ^'ith Project TALENT items is obvious, 
and the results compare favorably with the results 
of that study. 

It should be noted that in both Project TALENT 
and in Youth in Transition the outcome measures were 
ability m.easures rather than measures of academic 
performance. The title of thi.. chapter, "Correlates 
of Academic Performance" might imply that m.easures 
of ability should not be used as outcome measures 
here. In Section 2.3.4 we consider measures of ability 
as background variables, but elsewhere in this report 
one will find some measures of ability used as measures 
of educational outcome. 

Some of the tests in the battery used by Project 
TALENT (see Table 1) are highly performance oriented, 
and even the Quick Test used by Bachman, et al . , is 
word-oriented so that there is a nontrivial component 
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of accumulated knowledge in them. Therefore, in this 
soctior. we have used thetn as proxies for achievement. 
Doina so has permitted us to use the particularly rich 
Lackqround data of Project TALENT, Youth in Transition 
and selected other studies. We feel that the sacrifice 
of logical purity is more than offset by the increased 
anount of data available to us. 

Also the National Center for Health Statistics 
in its Health Examination Survey did a special study 
(22) of over 7,000 children in the aae qroup 6 to 11 
where some of the outcome measures reflected mental 
orowth and behavioral development. The Wechsler 
Intelliaence Scale for Children (WISC) , the Thematic 
Apperception Test and the Draw-a-Person test were used. 
It v;as shown that outcomes were associated with region, 
with race, with income and with education of parents 
in a manner which compares fav'orably with associations 
of those factors with achievement tests reported in 
this paper. 

Thorndike, in Reading Comprehension Education in 
Fifteen Countries (48, p. 76, 81), used father's oc- 
cupation, father 's education, mother's education, 
availability of reading matter in the home, number of 
siblings, and two unusual variables — parental inter- 
est and parental help with homev^ork (as reported by 
the student) — to achieve the followinq percentaaes 
of explained variance on readina-comprehension tests. 





SFS 


SFS and Other 




Alone 


Backaround 


Ten-year-old pupils 


10.9 


17.5 percent 


Fourteen-year-old pupils 


14.4 


25 . 8 percent 


Pupils in last year of 




secondary school 


13.0 


21 . 0 percent 



The results are for the students tested in the United 
States. Explained variance is aoain reasonably con- 
sistent with the studies reported above, althouah the 
included items are not identical and two additional 
aae aroups have been added. Note the closeness of 
correspondence of the three aae aroups to the 9, 13, 
and 17-year-old aae groups of interest to IIP^EP . 
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other studies in the series of International 
Studies in Evaluation have found similar results, 
Cori^er and Keeves (7, Chapter 9) in the science 
evaluations defined a "school handicap" in terms of 
occupation and education of father, education of 
niother, use of dictionary in the home, nurber of books 
in the hone, and family size. When the student was 
the unit of analysis, the explained variance for 
science scores for a national U.S. sample was: 



Ten-year-olds 16 percent 

Fourteen-year-olds 16 percent 

High school seniors 9 percent 

The 9 percent for high school seniors seems unusually 
low. However, if sex and age are added as variablc:S, 
the percentage increases to 18 percent for 10-year-olds 
22 percent for 14-year-olds, and 18 percent for 
seniors, results which are internally consistent and 
more nearly comparable with Thorndike's findings, 
above. The sex differential in science is known to 
be pronounced at the high-school-senior level, so, 
viewed in that light, the results are not surprising. 

Percentages of explained variance increase con- 
siderably when the school is cons'idered to be the unit 
of analysis. Comber and Keeves (7. Chapter 8) found 
the I'ollowing percentaoes of explained variance in 
averaue science scores when SFS measures (school 
handicap) were averaged for each U.S. school in the 
sample and the average school science score was the 
dependent variable: 

School Handi- School Handicap, 
cap Only Sex and Age 

Ten-year-olds 66 percent 67 percent 

Fourteen-year-olds 62 percent 67 percent 

High school seniors 36 percent 44 percent 

:;ote the (approximately) tripling of explained 
variance for 10 and 14-year-olds by usjinq the school 
as the unlL tor analysis. Note also the relatively 
low percent of variation accounted for in the average 
science scores of high school seniors. One might 
hypothesize that selectivity (i.e., Icsses due to 
dropout) and the educational process have created a 
different explanatory system for hiah school seniors* 
science performance than for that of younger students. 
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V^e havt^ found it necessary in n^any cases to use 
results in which the school, rather than the individual 
student, has been used as the unit of analysis. Since 
the difference in magnitude of the associations is so 
creat, we have identified the unit of analysis as the 
school whenever that unit has been used. 

Note that the higher associations when the 
i^chool is the unit of analysis occur partly because 
the base of the percentaqe is the variation among 
schools necins, not total variation among students. 
Thus, if school handicap, as defined by Comber and 
Keeves, accounts for 66 percent of the variance amor.g 
schooTi;, and only 25 percent of the total variance 
in scores is between school variance, one car' approx- 
irate roughly the percent of variance in total student 
scores accounted for by school handicap as 0.25 x 56 = 
16.5 percent. Unfortunately, the approximation is not 
very good and the proportion of variance between 
schools is usually not reported when the school is 
used as the unit of analysis. Mayeske (31-34) and 
Purves (41) are notable exceptions. 

Purves (41, Chapter 6) in the international 
evaluation of literature scores used approximately 
the sane backaround factors as Comber and Keeves. 
He only analyzed two aae croups, 14-year-olds and 
hiah school seniors, and found the following percent- 
ages of variance in individual student scores ex- 
plained by individual home backaround; 



N'ote the similarity to the results reported by Comber 
and Keeves and, again, the decline in association for 
hiaii school seniors. 

One of the best known studies of educational 
outcones is the Equal Educational Opportunity Survey, 
the Coleran report (5), Results obtained by Coleman 
and his colleagues are interesting in their own right, 
but sore of the reanalyses of his data by others are 
of particular relevance to this project. 



Home 
Background 
Aione 



Home Background , 
Reading Resources, 
Age and Sex 



Fourteen-year-olds 
Hich school seniors 



10.2 
7.3 



18.5 
16.5 
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Mayesko's analysis of the Coleman data (."^1, 311) 
sliowGd that the percent of variation in a cCiTposite 
measure of achif^vonent for individual students ac- 
counted for by backcfround variables was as shown in 
Table 2. 

Tabl'i? 2. Percent of variation in composite achieve- 
ment measure accounted for by background 
variables Coleman data 



Grade 



Background 




12 


9 


6 


3 


1 


1. SES 




23 


29 


25 


24 


15 


2. Family structure 


and 












stability plus 


(1) 


23 


30 


27 


26 


15 


3. Race plus (2) 




32 


36 


37 


31 


22 


4 . Sex plus (3) 




32 


37 


37 


31 


22 



Source: Mayeske (31, pp. 16, 17) 



These results are sor.ewhat higher than those found in 
the international studies, and, for twelfth-graders, 
somewhat below the Project TALENT results, above • 

Note also that race contributes an additional 
5 to 10 percentaae points to the percentage explained. 
N'one of the previously reported studies above have 
included race, and more will be said about the effect 
of race later. 

Mayeske used factor-analytic methods for creat- 
ing an index of achievement and then used criterion- 
scale analysis to create scales for questionnaire 
items that reflected SFS . That is, since 12th-grade 
students who reported "manaaer" as their father's 
occupation had an average standardized achievement 
index of 52.771, that value was assigned as the 
numeric code for "manaqer." This technique tended to 
maxim.ize the associations between the components of 
the SES measure and the index of achievement. The 
results from the factor analyses were then used in sub- 
sequent regression analyses. It is possible that the 
assignrent of criterion scales to questionnaire items 
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and the con^positinq by factor-analytic techniques pro- 
duced the apparent greater proportion of explained 
variance than was fotmd by the methcds of compositina 
used in the international assessments. The same set" 
of student scores was used by Mayeske in formincj his 
achievement index as in forming his criterion scales. 
This irust have added soretTiing' to predictability, even 
though the sample was large. 

Hilton, et al. (23), in a compilation of data 
from the Educational Testing Service "Academic Growth 
Study," used analysis of variance techniques in order 
to partition the total sum of squares of deviations 
of student scores fron their overall means into "main 
effects," "first order interactions," "second order 
interactions," etc., in the analytical pattern often 
used in experimental designs. A wide array of tests 
was used and those tests that were keyed to academic 
performance showed high sianificance of the father's 
education factor which was used as the measure of SES. 
Also, the interactions of that factor with many of the 
other background factors tended to be significant. 

The forthcoming final reports on the first wave 
of the "National Longitudinal Study of the High School 
Class of 1972" (25) will also show associations with 
SFS that are comparable with the principal results 
cited in this section. As of the date of preparation 
of this study the National Lonaitudinal Studies have 
not been released to the public so no specific data 
have been quoted in this report. Howevrar, the re- 
searcher interested in backaround factors should be 
aware of this important forthcoming series of reports. 

We could cite other findings in the literature 
to sumr.arize the level of association between measures 
of SES and measures of academic outcome. However, we 
feel that the importance of SFS and the amount of 
association to be expected in the explanation of 
differences in academic outcomes has been demonstrated 
conclusi'/ely by the references cited. We move now to 
a consideration of the ways in which SFS is measured. 
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2.2.2 Con^ponents of SES 



In considering measures of coirponents of SE5, a 
reality to face is that one often can't measure the 
thine: he really wants to measure but must settle for 
measuring one or more proxies. For example, he might 
like to know fairily income, but even carefully trained 
interviewers using multiple questions that, for example, 
distinguish between wages and take-home pay and iden- 
^Lfy other than wage income are unable to ascertain 
family income accurately. It certainly is expecting 
toe much of younger students to have them report 
family income even if such questions were permitted 
in all of the states. The result is that instead of 
asking students to report income one asks them to re- 
port such things as occupation of parents, automobiles 
and items in the home that reflect standard of living. 
These items are correlated with income and may serve 
as reasonable proxies for income, 

v;e now consider the following major components 
of SES: occupation of parents, items in the home, and 
education of parents. 

2.2.2.1 . --^ .7 1 ' >: Purser ts. One of the most com- 
m.on surroaates for income is occupation of father, or 
occupation of the mother if there is no father in the 
home. With the higher percentage of women working in 
recent years it seems surprising that more attention 
has not" been given to whether the mother is working 
(full- or part-time) and to her occupation. The fact 
that the mother is working may have an impact on cer- 
tain educational outcomes quite aside from the impact 
of a areater family income. 

The International Studies in Education have used 
ten occuoational categories. The categories were de- 
sianed by C. A. Anderson for the mathematics evalua- 
tion (26^, Vol. I, Chapter 8) and have set the pattern 
for subsequent evaluation. The complete classifica- 
tion is aiven in the referenced report, but the cate- 
gory names are given here: 

Group 1 - Higher professional and technical 

Group 2 - Administrators, executives, and working 
proprietors, large- and medium.-scale 
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Group 3 



- Subprofessional and technical 



Group 4 

Group 5 

Group 6 

Group 7 
Group 8 
Group 9 



- Small working proprietors (cthey than in 
J, J V : (? u Itui'C, ; V ye at , v fi s h ik^) 

- Proprietors and manaaers in aariculture, 
forestry, and fishing 

- Clerical and sales workers (lower levels 
of white-collar work) 

- Manual workers, skilled and semiskilled 

- Laborers (hired) in aqriculture, forestry 

- Unskilled manual workers (excluding agri- 
culture, forestry, fishing) 



Group 0 - Unclassified; no answer. 



Students were asked to "describe your father's occupa- 
tion carefully" and one of the above codes was assigned 
as part of the data processing. 

At a higher level of aqoregation one can combine 
(1 and 2), (3, 4, and 6), (7 and 9) and (5 and 8). 
B. S* Bloom et al . , ( International Study of Achievement 
in Mathematics: A Comparison of Twelve Countries , Vol- 
ume II, Chapter "5, "Social Factors in Education") (26) 
showed that achievement in mathematics in the Unite^ 
States was approximately linearly related to these ^ 
aggregations where the aqaregates are listed in re- 
verse order of "size," above, and are assumed to form 
a scale of equal units, 

Peaker ( International Study of Achievement in 
Mathematics; A Comparison of Twelve Countries , Volume 
II, Chapter 6, "A Regression Analysis") (26), in doing 
a regression analysis of mathematics achievement on 
occupations, used a second dimension, viz., whether 
the occupation was scientific or otherwise. He showed 
that for the United States the regression coefficient 
for the second dimension had small value and was neg- 
ative, indicating that the nine-cateqory scale con- 
tained effectively all of the information in the 
scientific/nonscientific classification as well. Al- 
though the text is not specific on the point it is 
believed from a remark in an earlier chapter that for 



33 



ERLC 



the purpose of regression analysis scale values of one 
to nine were assigned to the categories in reverse 
order of the above listing. 

Because of difficulties encountered in the math- 
ematics evaluation in constructing a scale of occupa- 
tions that was valid cross-nationally, the 
international literature evaluation (Purves, (41)) 
requested each country to construct its own scale. 
When these scales had obvious shortcoadngs the tech- 
nique of criterion scaling as described above in 
connection with the Mayeske report was usedJ 

In the international reading-comprehension eval- 
uation (48) each country developed its own categories. 
In the U. S. they were as follows: 



Code Num>ber Category 

9 Professional, technical and kindred 

workers 

8 Manaqers, officials and proprietors, 

including farm owners and managers 

7 White-collar workers 

6 Skilled manual workers 

5 Semiskilled manual workers 

4 Farm vorkers, fishery, forestry and 

kindred groups 

3 Domestic and personal service workers 

2 Laborers 

1 Unclassif iable 

0 Unknown 



^ See A. F. Beaton's paper in Mayeske et. al., A Study 
of Our Nation's Schools (32, Appendix). 
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Coding was done centrally on the basis of the 
student's report of the specific job that his father 
held. The method of convertinc? to a nurrerical score 
is described by Thorndike as follows: 

In order to translate the coding of Father's occu- 
pation into a score that would be an effective 
predictor of reading achievement, a rearession 
analysis was carried out of the several categories 
of the score, assigning each individual a code of 1 
for the category in which his father's occupation 
fell and a code of zero for all other occupations. 
So, in the United States, the nine cateaories of 
occupation were treated as nine dummy variables, 
and that weighting was determined for this set of 
nine variables that would maximize the correlation 
of the set with Reading Comprehension score. Thus, 
Father's occupation was empirirally scaled in such 
a way as to maximize its predictive effectiveness. 

Scaling of father's occupation was done for the 
14-year-old population and that scale was also used 
for the 10-year-old population and for hiah school 
seniors. 

Comber and Keeves (7), in the international 
science evaluations, used the same technique of cri- 
terion scaling as Purves, above. Thus, we see that 
the framework for the international studies is the 
nine-category classification of occupations based 
upon descriptive reportina by students and centralized 
coding and (for recent studies) assianment of scale 
values by the method of criterion scaling, 

Conber and Keeves (7, Chapter 9) report the 
following percentages of variance in individual stu- 
dent scores in science accounted for by father's 
occupation (U.S. data); 

Ten-year-olds 15,2 
Fourteen-year-olds 9,6 
High school seniors 4,4 

Agc.in, we note the decline with increasing age that 
has been observed earlier. These percentages compare 
with 16, 16 and 9 percent, for the three aae groups, 
respectively, that Comber and Keeves attributed to 
occupation and education of father, education of 
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ir.otheri use of dictionary in the home, number of books 
in the hoi^.e and faivily size. Thus, for tcn-ycar-olds , 
occupation of father accounts for substantially all 
of the variation of the larger set, and for high- 
school seniors, to about half of the variation of the 
larger set of variables. 

The Colen'.an studies (5) elicited information 
fron school personnel concerning the occupational 
status of the student's father for first- and third- 
urade students and from the students themselv^^s for 
sixth, ninth, and twelfth grades. In both cases a 
preceded check response was sought rather than a ver- 
bal description which had to be coded subsequently. 
The categories for the student response were as 
follows : 

18. v;hat work does your father do? You probably 
will not find his exact job listed, but check 
the one that comes closest. If he is now out 
of work or if he's retired, mark the one that 
he usually did. Mark only his main job if he 
works on more than one. 

(A) Technical — such as draftsman, surveyor, 
medical or dental technician, etc. 

(B) Official — such as manufacturer, officer in 
a large company, banker, government official 
or inspector, etc. 

(C) Manager — such as sales manager, store mana- 
ger, office nanager, factory supervisor, etc. 

Proprietor or owner — such as owner of a 
small business, wholesaler, retailer, con- 
tractor, restaurant owner, etc. 

(D) geipiskilled worker — such as factory machine 
operator, bus or cab driver, meat cutter, etc 

Clerical worker — such as bank teller, book- 
keeper, sales clerk, office clerk, mail 
carrier , messenger , etc . 

Service worker — such as barber, waiter, etc 

Protective worker — such as policeman, de- 
tective , sheriff, fireman, etc. 
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(E) Salesman ~ such as real estate or insurance 
salesman , factory representative, etc. 

(F) Farm or ranch manager or owner 

(G) Farm, worker on one or more than one farm 

(H) ^^orkman or labore r — such as factory or mine 
worker, f isherman7 filling station attendant, 
longshoreman , etc . 

(I) Professional — such as accountant, artist, 
clergym.an , dentist , doctor, engineer, law- 
yer, librarian, scientist, college professor, 
social worker, etc. 

(J) Skilled worker or foreman — such as baker, 
carpenter, electrician , enlisted man in the 
armed forces, mechanic, plumber, plasterer, 
tailor, foreman in a factory or mine, etc* 

(K) Don * t know 

Suitable modifications in wording were made for the 
school response for first and third grades. 

As described earlier, Mayeske (31, ,'2) used 
criterion scaling to assign values to categories A 
through K above, different values being assigned for 
each grade level. His criterion scale values are 
shown in Table 3. He noted that twelfth-graders who 
uid not know their father's occupation had a lower 
achievement index than first, third or sixth-graders. 
This assignment of separate criterion scales to each 
grade may have been one of the procedures that gave 
Mayeske a higher explained variance than was found 
by the researchers in the international evaluation 
studies. The effect of that procedure is confounded 
with the fact that the Coleman survey used preceded 
categories and the international studies used de- 
scriptive language which was coded into categories 
in the data-processing phase, 

Percents of variance explained shown in the last 
line of Table 3 were computed from tabulations of 
average criterion scores and frequency tabulations 
provided us by Dr. Mayeske (34). The lower explained 
percentage for third grade may reflect the fact that 
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Table 3. Scale values assigned by Mayeske to 
occupation of father Coleman data 



Meiins for the Different 
Grade Levels 



Fat'hpy ' s Occuoation 


Third 


Sixth 


Ninth 


Twelfth 


A, Technical 


54.4 


48.7 


52.7 


52.4 


B. Official 


54,5 


52.8 


52 .3 


52 . 7 


C. Manager 


54.6 


53.6 


53.5 


52.8 


D. Semiskilled 


50.1 


50.0 


50.1 


49.5 


• V? Cl X C SlllCll 1 


53.9 


54.1 


53.9 


5:, 6 


F. Farm or ranch 










manager or owner 


52.9 


50.2 


50 ,4 


50.7 


G. Farm worker 


45.7 


45 .5 


43.3 


42.5 


H. Workman or laborer 


45.9 


49.0 


4 8./ 


4 / • ^ 


I. Professional 


56.8 


55.3 


56.6 


56.0 


J. Skilled worker or 










foreman 


50.8 


51.4 


51.0 


50.6 


K. Don't know 


45.7 


44.1 


43.1 


41.8 


Nonresponse 


48.8 


45 .0 


42.6 


42.3 


Total 


50.0 


50.0 


50.0 


50.0 


Percent of variance 










explained 


10.4 


12.0 


15.0 


12.2 



occupation of father was obtained from teachers for 
third graders and from the students themselves in 
otner grades. The drop off in explained variance 
for twelfth graders will be noted :!requently in this 
report. It has been suggested that high school drop- 
outs tend to make the senior class more homogeneous 
than other grades. 

Bachman, in Youth in Transition (51, Volume II), 
used Duncan's scale (Reiss (42) ) . Categories were 
assigned by coders based upon verbal description of 
father's occupation. Since the use of Duncan •s scale 
is frequently encountered in the literature, it seeras 
desirable to discuss it briefly here. 

Duncan used two variables in the construction of 
his index, both available from the 1950 Census.^ The 
first was percent ol the persons in the occupational 
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cateaory receiving mere than $3,500 in income, and the 
second was percent with at least a high school 
education. Gome adjustp-^ent was made in income dis- 
tribution to standardize to a given acre* The index 
i£3 found by weighting the first variable by 0.59, the 
second by 0.55 and subtracting 6*0, these constants 
being obtained by regression methods using the NORC 
prestige scale as a criterion (Reiss, 42). The scale 
value was produced for each occupation in the detailed 
occupational classification of the Census, The com- 
plete scale is given in Appendix B of Reiss (42). 

Flanagan et. al., in Project TALENT (13), asked 
several questions related to occupation; 

131. Does your father work for pay on more than one 
job? 

132. Does your father direct or supervise the work 
of other people? 

133* As far as you know, which one of the following 
best describes your f ather'T^responsibility for 
money and property on his job? (Four categor- 
ies plus "don't know") 

134. Has your mother worked -for pay at any time in 
the last three years? 

135. How long has your mother been working for pay? 

How active has your father been in any one or more 
of the following organizations? 

141. Labor-union or trade-union activities? 

142. Business or professional association? (Ques- 
tions 151 and 152 were parallel to 141 and 142, 
except with reference to mother's activities) 

In addition, two occupational questions were 
asked. Question 206 identified the father's occupa- 
tion in one of 17 categories as follows: 

A. Farm or ranch owner and/or manager 

E. Farm or ranch foreman 

C. Farm or ranch worker 
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D. Workman or laborer — such as factory or mine 
worker, fisherman, filling station attendant, 
longshoreman , etc . 

E. Private household worker — such as servant, but- 
ler, etc. 

F. Protective worker — such as a policeman, detec- 
tive , sheriff, fireman 

G. Service worker — such as barber, beautician, 
waiter, etc . 

H. Semiskilled worker — such as factory machine 
operator, bus or cab driver, meat cutter, eve, 

I. Skilled worker or foreman — such as baker, car- 
penter, electrician, enlisted man in the armed 
forces, mechanic, plumber, plasterer, tailor, 
foreman in a factory or mine (but not on a farm) , 
etc, 

J. Clerical worker — such as bank teller, book- 
keeper, sales clerk, office clerk, mail carrier, 
messenger, etc, 

K. Salesm.an — such as real estate or insurance 
salesman, factory representative, etc. 

L. Manager — such as sales manager, store manager, 
office manager, business manager, factory super- 
visor, etc. 

M. Official — such as manufacturer, officer in a 
large company, banker, government official or 
inspector, etc . 

N. Proprietor or owner such as owner of a small 
business, wholesaler, retailer, contractor, 
restaurant owner, etc. 

0. Professional such as actor, accountant, artist, 
clergyman, dentist, engineer, lawyer, librarian, 
scientist, etc . 

P. Technical — such as draftsman, surveyor, medical 
or dental technician, etc. 
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Q. I don't know. 



If the respondent answered 0 or above ^ he was given, 
in question 207, a list of 35 professions co check. 
The sane questions were irepeated for mothers if they 
were working for pay. 

In Appendix E to The American High School Student 
(13), Flanagan reported number of students of fathers 
in each of the above occupational classes who fell in 
each decile of his ability measure. From these data 
it is possible to estimate the percent of variance 
in ability (which we use as an approximation to educa- 
tional performance) accounted for by father's 
occupation. The computations were made by us only for 
ninth grade girls and are shown in Table 4. 

Table 4. Relationship between father's occupation 
and m.easures of ability for ninth grade 
girls Project TALENT data 



Number of Average Per- 
Occupational Category Observations centile Rank 



A. 


Farm or ranch 












owner/panager 




963 


46 


.88 


B. 


Farin or ranch foreman 




136 


24 


.08 


C. 


Farn or r=^nch worker 




436 


31 


.19 


D. 


Workman or laborer 


2 


,128 


47 


.80 


E. 


Private household worker 




54 


17 


.59 


F. 


Protective worker 




115 


47 


.95 


G. 


Service Worker 




127 


45 


.70 


H. 


Semiskilled worker 




654 


51 


.86 


I. 


Skilled worker 












or foreman 


1 


,631 


56 


.86 


J. 


Clerical worker 




212 


59 


.95 


K. 


Salesm.an 




321 


65 


.84 


L. 


Manager 




468 


62 


.39 


M. 


Official 




135 


57 


.96 


N. 


Proprietor 




561 


65 


.81 


0. 


Professional 




382 


66 


.47 


P. 


Technical 




180 


67 


.06 


Q. 


Don ' t know 


1 


,579 


35 


.08 


X. 


Nonresponse 




766 


31 


.12 



Estim.atea percent of variance accounted for = 16.0 
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In the one-year followup study (14), iterrs 132# 
13 3 , 142 , 206, and 207 wore used in the measure of SE'S, 
alone? with 21 other iters. Simple correlations with 
the two parts of the "Information" test showed that 
the responsibil ites response^ question 133, had a 
correlation of 0.14 with both parts of the information 
test and question 206 a correlation of 0.26 with one 
part and 0.24 with the second part of the information 
test. Other sim.ple correlations were less than 0.10 
and were not reported. Note that the above figures 
are correlation coefficients and not percents of ex- 
plained varxance (squares of correlation coefficients). 
Thus, father's occupation alone accounts for six of 
seven percentage points of the 2 7 or 28 percent of the 
individual variance in the Information parts of the 
tests accounted for by the full set of environmental 
variables (see Table 1). Only father's occupation 
was included in the final Socioeconomic Environment 
Index for the one-year followup study with the follow- 
ing scalina: 

Scale Score I'ter' 206 Response 

1 C. Farm or ranch worker' 
D. Workman or laborer 

F. Private household worker 

2 Ci . Service worker 

H. Semiskilled worker 

3 B. Farm or ranch foreman 
F. Protf-ct-ive worker 

I. Skilled worker or foreman 
J. Clerical worker 

4 A. Farm or ranch owner 
K . Salesman 

L. Manaaer 

N. Proprietor or owner 
P . Technical 

5 M. Official 

0. Professional 

This scale apparently was used in computina the cor- 
relation cited above. 
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From the cited referoncos it appears that occu- 
pation of father is a sianificant component of SES. 
Alone it can account for from (say) 5 to 15 percent 
of variation in academic perforipanco measures. 



2.2.2.2 Ite^'-c in the Here, Since it is difficult, 
and often inpossible, to obtain information on family 
income directly, a conronly used surrogate is items 
in the hor.e such as appliances, television, automobile, 
and so on. The possession of a number of such items 
is presured to be correlated with family incom.e. In 
addition, the possession of some items is presumed to 
reflect an attitude toward learnina on the part of 
the parents. An encyclopedia, a dictionary, and a 
subscription to a daily newspaper qualify as items of 
this kind. Some items are quite specifically re- 
lated to the subject matter that is the focus of NAEP 
exercises. Fxamples are subscriptions to science, 
literary, music and art magazines, the possession of 
musical instruments paintings, classical-music re- 
cordinas, and so d Most items, however, are assumed 
to be correlated wi academic performance in a more 
general way. 

At the present time, NAFF is requesting infor- 
mtation on the following item.s in the home: 

Daily newspaper 
Magazines (reaularly) 
More than 25 books 
Encyclopedia 

We understand that NAFP chose these items on the basis 
of a study which collected data on a larger number of 
such items and which investigated association with 
other m.easures of SFS. 

Examination of some of the principal resear:;h 
papers relating educational outcom.es to background 
irpresses one with the variety and complexity of items 
for which data have been collected and the paucity of 
careful analysis of the relationships. Even though a 
classification of household items is artificial, it 
is heloful to aroup items accordina to whether they 
reflect prirarily income, general hope educational 
environment, or special home educational environment. 
Obviously, items that are present in nearly all homes, 
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or in very fow hordes # cannot serve as useful indica- 
tions of SFS level, but may be helpful in identifying 
snail subgroups with special interests. Some of the 
items requested in principal studies are the follow- 
ing (5, 1, 13) : 



Income Indicators 



Television set 

Telephone 

Refrigerator 

Automobile 

Vacuum cleaner 

Rooms in home 

Separate room for student 

Bicycle 

Automatic washer 

Clothes dryer 

Dishwasher 

Food freezer 

Sterling silver 

Wall-to-wall carpeting 

Ceiling-to-floor draperies 

Various identified sports equipment 

Power tools 

General Home Educational Environment 

Dictionary 

Encyclopedia 

Daily newspaper 

Number of books in home 

Magazine subscriptions 

Map or globe of the world 

Typewriter 

Special Home Educational Environment 

Record player, hi-fi or stereo 

Bible 

Camera 

Dog or cat 

Fish in a tank 

Pair of binoculars 

Numi^er of phonoaraph records 

Specifically named raaazines 

Identified kinds of r.aaazines (10 kinds) 

Paintings 
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Tapestries 

Musical instruments 

Art equippent 

Photographic development equipment 
Hand tools 

Clearly, the classification of many items is arbitrary 
and the list is bv no means exhaustive. 

Armor in his reanalysis of the Ccleman d.^ta re- 
ported correlations of sixth-grade verbal achievement 
with th3 household items index formed by givina one 
point each for possession of television, telephone, 
record player or hi-fi, refrigerator, dictionary, 
encyclopedia, automobile, vacuum cleaner and daily 
newspaper. The data are summarized in Table 5, 

Table 5. Correlation of school-average sixth-grade 

achievement scores with school means of the 
household items index -- Coleman data 



Class 






r 


2 

r 


Black achievement in black 


schools 








Metropolitan - North 




0 


.59 


0.35 


Metropolitan - South 




0 


.54 


0.29 


Nonmetropolitan - South 




0 


.39 


0.13 


White achievement in white 


schools 








Metropolitan - North 




0 


.71 


0.51 


Metropolitan - South 




0 


.66 


0.44 


Nonmetropolitan - North 




0 


.38 


0.14 


Nonmetropolitan - South 




0 


.72 


0.52 



Source; Armor v37, p. 213) 



Note that the school rather than the student is the 
unit of analysis in the computation of the correlations 
in Table 5. We are, of course, most interested in the 
correlations among individual characteristics and out- 
comes, dnd as we have seer, correlations such as the 
above for school averaaes account for a much smaller 
fraction of the individual outcomes than is indicated 
by the squared correlation for schools. 
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Mayeske (31, 32) in analyzing the Coleiran data 
assinned a scale tn items in the home by use of cri- 
terion jacalina (Beaton, 32, Appendix I) and by re- 
duction in nurber of items by factor-analytic methodSt 
Separate scales v?ere constructed for first, third, 
sixth, ninth, and twelfth arades. The scale values 
are qiven in Table 6 for third, sixth, and twelfth- 
oraders, grades which rouahly coincide with age levels 
1, 2, and 3 of the National Assessment. The scale 
values have been rounded to one decimal point from 
three for convenience. 

These s^cale values are averages of the criterion 
(achievement composite) standardized to a m.ean of 50 
and standard deviation of 10. Thus, an iter, has poten- 
tial to discriminate between high and low ovtcome if 
there are large differences in the scale values for 
the various response categories in Table 6. All of 
the items seem to be related to outcomes. Among the 
appliances, the one that seems to have greatest 
discriminating capability is presence or absence of a 
refrigerator. However, the number of "no-refrigerator" 
responses is quite sm.all. The amount of consistency 
am.ong the item-s leads one to believe that the aggre- 
gate cf a sim^ple scale formed by giving a score of 1 
for presence and 0 for absence (as was done by Armor) 
might be reasonably effective. The scale values 
assigned to number of magazines and number of books 
are approximately linear on the classes employed if 
one combines "7 or more" magazines with "5 or 6." 
It should be noted, however, that there is nothing in 
the criterion-scaling procedure which permits one to 
assian greater weight to one item (say, dictionary) 
than to another item (say, encyclopedia) if both are 
to be used in the composite. Such differential 
weiahts can be determined in a subsequent analysis by 
regression analysis, factor analysis or other methods 
to aid ir judgments. 

The percent of houses havina an item, is so im- 
portant to the amount of variance explained by that 
iter that it has been analyzed for twelfth graders in 
TaLle 7. Thus we see that, as mentioned above, lack 
cf a refrigerator in the home marks the stud»3nt from, 
that home as one with an educational handicap, but 
less than two percent of homes reported no refrigerator. 
As a result, possession ;f a refrigerator only accounts 
for 1.5 percent of the variance in the criterion. 
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Table 6. Scale values used by Mayeske for items in 
the home ~ Coleman data 

Grade 



Itep Response 3 6 12 



Television Yes 50*^4^50.6 50.2 

No 44.5 42.6 45.2 

N.I^ 42 . 1 37 .7 4 3.2 

Telephone Yes 51.4 51.6 50.9 

No 45.2 44.1 43.2 

N.R. 42.5 37.1 42.9 

Record pKnyer, hi-fi, 

or stereo Yes 50.8 51.1 50.4 

No 47.443.447.3 

N.R. 43.6 36.9 43.3 

Refrigerator Yes 50.3 50.9 50.2 

No 4 3.5 38.3 39.5 

N.R. 42.5 36.7 43.5 

Autorobile Yes 51.6 51.2 50.6 

No 44.6 42.3 42.5 

N.R. 44.6 36.1 42.8 

Vacuu.T cleaner Yes 51 .6 52 .0 

No 4 5 .2 4 3.7 

N.R. 44.4 36.5 

Readin:; Materials in Hore 

Dictionary Yes 51.3 51.2 50.3 

No 45.6 42 .9 41.7 

D.K. 48.6 39.7 - 

N.R. 42.9 36.5 43. V 

Encyclopedia Yes S3 9 52.2 51.0 

No 46.8 46.2 46.1 

D.K. 49.0 40.7 - 

N.R. 44.3 36.9 41.6 

Caily newspaper Yes 51.1 51.5 50.8 

No 48.2 46.3 45.8 

N.R. 44.2 39.2 44.4 

r.'urber of raaazines None 45.9 

1 or 2 48.5 

3 or 4 50.9 

5 or 6 53.6 

7 or rroro 52.7 

N.R. 42.5 

::urLer of books 0-9 44.5 

10-24 45.9 

25-99 49.7 

100-249 52 .6 

250 or more 54 . 4 

N.R. 42.8 



.-T-;r';o: .Vayc»skc (32, Appendix ITI) 
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Table 7. Percent of students reporting items in the 
home and j^ercent of variance explained for 
twelfth-graders — Coleman data 

Percent answering Percent of 
— — ^— — ^— — Explained 
Yes No Nonresponse Variance 



Appliances 



Television 


96.8 


2.5 


0.7 


0 


.9 


Telephone 


88.2 


11.0 


0.8 


6 


.3 


Record player, 












hi-fi or stereo 


88.4 


10 .8 


0.8 


1 


.3 


Refrigerator 


98.1 


1.1 


0.7 


1 


.5 


Automobile 


92 .8 


6.4 


0.8 


4 


.4 


Vacuuir. cleaner 


85.0 


14 .2 


0.8 


9 


.1 



Reading materials 
in hone 



Dictionary 


96.9 


2 


.3 


0 


.8 


2.0 


Encyclopedia 


80.4 


18 


.8 


0 


.9 


4.4 


Daily nev;spaper 


85.1 


13 


.9 


1 


.1 


3.3 


Number of 














r.agazines 


* 


* 




* 




6.2 


Number of books 


* * 


** 




* * 




10.1 



* None 12.6 
: or 2 30.5 
3 or 4 33.0 
5 or 6 14.3 
7 or more 8 ,6 
Nonresponse 1.0 



0-9 5.8 

10-24 18.8 

25^99 36.6 

100-249 21 .6 

250 or more 16 .1 

Nonresponse 1 .1 



Presence or absence of a vacuum cleaner, on the other 
hand, accounts for 9.1 percent of the variance in the 
criterion. Number of books in the home emeraes as the 
I:est sinale predictor for twelfth-graders, accounting 
for over 10 percent of the variance. 

Items in the home undoubtedly have different 
predictability for various population subgroups and 
that difference is not exposed by the above analysis. 
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Marshall Smith (3 7, Chapter 6) separated the 
Coleman data on iter.s in the hone into (1) reading 
material and (2) other itens. Althouah the text is 
not specific, he appears to have used sin^ple counts 
of items as Armor did. Fe reported simple correla- 
tions between these variables and individual verbal 
achievement, as shown in Table 8. 

Table 8, simple correlations of readina material 

and items in the home with verbal achieve- 
m.ent Colenan data 

Reading Items 
Group Material in Home 



Sixth Grade 



Northern Black 0.21 0.23 

Northern White 0.2 3 0.22 

Ninth Grade 

Northern Black 0.16 0.15 

Northern White 0.2 7 0.17 

Twelfth Grade 

Northern Black 0.15 0.13 

Northern White 0.2 9 0.13 



Source: Fmith (37, Chapter 6, Appendix) 



The multiple correlations, using both reading 
material and items in home, are not given. It should 
be noted that correlations across students in all 
schools would be expected to be somewhat higher than 
those shown in Table 8. 

Project TALENT collected data on many items in 
the home with particular emphasis on kinds of maga- 
zines reaularly taken. Unfortunately, there is limited 
published data on the associations between possession 
of specific items and outcomes. The thrust of Project 
TALENT was to identify ability, so measures of ability 
m.ust be used in place of academic performance. However, 
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many of the tests arc porformance-oriented, A com- 
posite n^easure of academic aptitude was used as a cri- 
terion variable in an analysis which permits one to 
draw an association with number of books in the home 
(13, Appendix E) . Table 9 ctives median number of books 
in the hone for deciles of the academic-aptitude 
criterion . 

Table 9. Median books in the hom.e (excluding non- 
response) for deciles of the Project TALENT 
academic-apt itudtj criterion 



Median Rooks in Home 





9th 


9 th 


12th 


12th 


Aptitude 


Grade 


Grade 


Grade 


Grade 


Decile 


Boys 


Girls 


Boys 


Girls 


1 


51 


25 


62 


47 


2 


39 


44 


51 


4 9 


3 


53 


44 


58 


40 


4 


53 


54 


63 


59 


5 


64 


58 


65 


60 


6 


65 


58 


65 


67 


7 


72 


67 


73 


71 


8 


79 


72 


83 


77 


9 


93 


73 


95 


89 


10 


118 


102 


123 


147 



Source: Project TALENT (13, Appendix E) 



Also Cooley, Dalcanton, McMillen et, al. (14, 
Appendix E) reported simple correlations between se- 
lected item.s in the home and various measures of 
ability. The two "information" components of the abil 
ity tests are probably closer to measures of academic 
performance than are the other ability tests. Corre- 
lations reported by Cooley et. al . are given in Table 
10. Most of the questions were asked in terms of how 
many of the given items were in the home. Most ques- 
tions provided for answers of none, one, two, three, 
four, five or more. Categories for number of books 
were 0-10, 11-25, 26-100, 101-250, 251-500 and 501 
or more . 
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Table 10 • Selected correlations between household 
items and two components of the informa- 
tion test. Project TALENT 



Correlation Coefficients 



Items 


Information I 


Information II 


Boolis in home 


0.28 


0 .29 


•\ews magazines 




it 


Culture magazines 


it 


it 


Literary magazines 


0.14 


0.15 


Appliances 


0.24 


0.26 


TV, radio, 




telephone, etc. 


0.33 


0.35 


Luxury items 


it 


0.10 


Cultural equipment 


0.17 


0.16 


Sports equipment 


0.17 


0.18 


Own room and desk 


0.30 


0.30 


Hand tools 


0.17 


0.14 


Power tools 


it 


it 


Cars owned 


it 


i: 


Year of car 


0.12 


0.14 



Less than 0.10. 



Source: Project TALENT (14, Appendix E) 



When the correlations in Table 10 are squared one can 
see that the percentage of variation explained by any 
one of the iterps does not exceed 12 percent. However, 
the four relatively most important associations with 
the information test are, in order of importance: 

T.V., radio, telephone, etc. 
Cv7n room and desk 
Nuirber of books in home 
Number of appliances 

Intercor relations am.ong these four items were reported 
as shown in Table 11, 

Note that number of books is poorly correlated with the 
other variables and hence would contribute substantially 
to variance explained by the others. The authors 
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Table 11. Correlations amona items in home 
Project TALENT data 



Items 



1. TV; radio, telephone, etc, 

2. 0\\n room, and desk 

3. Number of books in home 

4. Number of appliances 



1.00 
0.32 



0.32 
1.00 



it 



0.46 
0.30 



it 



it 



1 .00 



it 



0.46 



0.30 



it 



1.00 



Less than 0.30. 




appliances , (3 ) TV, radio , telephone , etc . , and (4 ) own 
room (the four identified above) to be included in their 
socioeconomic environr.ent index. The primary selec- 
tion criterion was that "...the items selected had to 
be answerable by most of the students and had to mea- 
sure aspects of the environment closely related to 
student ability." The final socioeconomic environment 
(SEE) index contained five other iter^ as well (value 
of hone, family income father's occupation, father's 
education and mother's education) and was formed by 
adding together the standard scores for the nine items 
(i.e., standardized to mean 100 and standard deviation 
10). The weightings that wculd have resulted from a 
regression analysis are unknown and cannot be computed 
fromi the published data. 

Bachnan et. al . in Youth in Transition recorded 
presence or absence of 19 items in the home with the 
percent rr^porting them as shown in Table 12. A six- 
point scale was constructed as follows: 



10 or 11 items 

12 or 13 items 

14 or 15 items 

16 or 17 items 

18 or 19 items 



9 or fewer items 



1 
2 

3 
4 
5 
6 
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Table 12. Percent of students' homes containing 

items reflecting SFS — Bachman data 

Percent Percent 

Item Having Item Having 



Radio 


97 


Typewriter 


66 




Qn 

y u 


uog or cat 


07 


Television 


96 


Fish in a tank 


20 


Bicycle 


84 


Daily newspaper 


79 


Phonograph 


87 


Magazine 




Dictionary 


96 


subscription 


79 


Set of 




Pair of 




encyclopedias 


81 


binoculars 


49 


30 other books or 




More than 10 




more 


86 


phonoaraph 




Family car 


92 


records 


88 


Camera 


92 


Map or globe of 
the world 


81 



Source: Youth in Transit: m (1), Volume II, p. 12) 



In addition, nuinber of books 
obtained and scaled as follows: 



in the house was 



few (0-10) 
(26-100) 



•None , or very 
A few (11-25) 
One bookcase full 
Two bookcases full (101-250) 
Three or four bookcases full (251-500) 
A room full — a library (501 or more) 



1 
2 
3 
4 

5 
6 



Simple dorrelation coefficients are reported as 
follows : 



1. Quick Test 

2 . Items in home 

3. Books in home 



1.00 
0.34 
0.28 



0.34 
1.00 
0.43 



0.28 
0.43 
1.00 



These results are reasonably in line with the results 
reported by Flanagan et. al . , above, for Project 
TALENT and summarized in Table 10. Note again that 
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the Quick Test is an ability test, rather th^ a per- 
forirance test, but it clearly is related to accumulated 
knowledge . 



Soire simple manipulation of the above figures 
shows that the followino percentages of variation in 
Quick Test scores can be accounted for: 



These results appear to summarize reasonably well what 
can be expected from using items in the home as an 
indicator of SFS. 



2.2.2.3 Education of Parents. Education of father or 
mother or both has frequently been used in measures of 
SES. Education of parents is correlated with occupa- 
tion and with incom.e, but apparently contributes some- 
thing additional to predictability of academic 
outcomes. 

The Coleman survey (5) asked for education of 
each parent in terms of* the following categories: 

(A) None, or some grade school 

(B) Completed grade school 

(C) Some high school, but did not graduate 

(D) Graduated from hioh school 

(E) Vocational or business school after high school 

(F) Sor.e colleae, but less than four years 

(G) Graduated from a four-year colleoe 

(H) Attended araduate or professional school 

(I) Don't know 

The survey administrator completed the data for first 
and third orades, and there was student response for 
sixth, ninth and twelfth grades. 

Mayeske (31, 32) used the method of criterion 
scalino to assign scale values to the above cate- 
gories with the results shown in Table 13 for third, 
sixth, and twelfth arades. Again, these values are 
scaled to an overall m.ean of 50 and standard devia- 
tion of 10. The scales for fathers and m.others show 



By items in the home alone 
By books in the hom.e alone 
By item.s in the home and books 



12 percent 
8 percent 



in the home together 



14 percent 
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great sirilaritiGs in pattern. Fducation of husbands 
and wives is, of course, correlated. 



Table 13. Scale values assigned by Mayeske to 

parental-education categories — Coleman 
data 

Grade 



Educational Level 3 6 12 



Father's Education 



None, or sore grade school 43.2 43.9 45.2 

Conpleted grade school 47 .3 46.* 4 48 !2 

Soir.e high school, but did not oradueite 48 .'2 49 [4 49^0 
Graduated from high school 52.1 52.4 Si!? 

Vocational or business school after 

high school 
Soire college, but less than four yea 
Graduated fron a four-year college 
Attended graduate or professional 

school 
Don't know 
N'onresponse 

Percent of variance explained 

Mother * s Fducation 

None, or sorre arade school 
Corpleted grade school 
Some high school, but did not gradual 
Graduated frop hiah school 
Vocational or business school after 

high school 
Sone college, but less than four yeai 
Graduated fror a four-year colleoe 
Attended graduate or professional 

school 
Don ' t know 
.\on response 

Percent of variance explained 



54 .2 


50.5 


53.4 


54.8 


54.1 


54.3 


56.2 


55.1 


55.1 


58.2 


56.0 


57.4 


48.3 


48.7 


43.9 


48.6 


44.6 


43.1 


11.2 


9.8 


12. S 


42 .6 


43.3 


-.4.5 


46 .4 


45.2 


46 .9 


47.7 


48.5 


47.6 


52 .2 


52.8 


51.6 


55 .8 


52.3 


54.8 


54 .8 


53.7 


54 .4 


56 .5 


54.2 


55.4 


55 .8 


52 .5 


55 .3 


48 .6 


48.5 


43 .9 


48 .9 


44.4 


43.9 


10.1 


9.6 


11.9 



Source: .Mayeske (32, Appendix III) 
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Bachman in Youth inTransition used the follow- 
ing categories of parental education: 



Less than high school 
Some high school 
Completed high school 
Some college 
Completed college 

A linear five-point scale was applied to the above 
five categories. Some key correlations were reported 
by Bachman as follows: 



Father's education alone accounts for 8 percent of the 
variation in reading achievement, mother's education 
for 6 percent^ and the two together 10 percent. 

Project TALENT (13) used the same education 
categories as Coleman # above, except that m^ster's 
degree and doctorate or professional degree were added 
as specific categories. Although the text is not 
specific (14, p. E-10) it is believed that a simple 
linear scale was used in the analysis. It was found 
that both father's education and mother's education 
correlated about 0.27 with the information components 
of the TALENT ability tests and 0.45 with each other. 
Note the similarity to the Bachman results cited 
above. 

Husen in the International Study of Achievement 
in Mathematics (26) asked, ''For how many years did 
your father (mother) receive full-time education?" 
Responses were recorded in number of years and ap- 
parently these values formed the scale for analysis. 
This set the pattern for subsequent international 
studies. Husen showed a correlation between mathe- 
matics score for 13-year-olds and education of father 
(U.S. results) of 0.30 and 0.28 with education of 
mother. Again, note the consistency with the results 
of Flanagan and Bachman. 



1, Reading achievem.ent 

2, Father's education 

3, Mother's education 



1,00 
0,28 
0.25 



0,28 
1.00 
0.51 



0.25 
0.51 
1.00 
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Education of father (or of both parents) was in- 
cluded as a background variable in all of the interna- 
tional studies as part of the measure of SEf?, but the 
unique contribution to the SES measure was oenerally 
not computed. 

The results cited lead one ^ => believe that ed- 
ucation of both parents may account for around 10 
percent of individual variation in academic test out- 
cor.es and that education of father alone miaht account 
for something like three-fourths of that. 



2.3 Personal Characteristics of Students 

In this section we discuss the associations 
between academic achievement and those characteristics 
of the student that are immutable such as race, sex, 
age, family structure and student ability, although, 
except for race and sex, immutability is a shorL- 
range concept. 



2*3.1 Ethnic Group Membership 

we suggest that race not be included as a com- 
ponent of SES, although Mayeske (31) showed that race 
contributed an additional 5 to 10 percent to explained 
variation after SES and family structure and stability 
had been accounted for. Armor (37, p. 217) has shown 
that percent black in the school has strong predict- 
ability as a school variable. 

• It is the largest of the community input factor 
coefficients. Thus, percent black explains more 
variation in achievement even when four other socio- 
economic factors are controlled. This tends to 
confirm the notion that black families (or communi- 
ties) , on the average, may be more disadvantaged 
vis-a-vis v^hites than can be determined by objective 
social-class measures alone. 

This view seems to be widely held and forms the basis 
for much of the literature on what is meant by equal 
educational opportunity. (See, for example, Hauser, 
(21, pp. 13ff ) ) . 
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Coleman (5, Section 3.2) has shown how important 
race (or ethnic aroup) is to the arount of variance 
explained by backaround factors. His results appear 
to show that backaround factors are differentially 
ir.portant for various nunority groups, which suggests 
that adjustment for backrrround should be done separ- 
ately for the principal minority groups (andi possibly, 
for geoaraphic reaion) • 

We have assured that there are compelling reasons 
why race of student should be recorded and used in the 
analysis and therefore have not made any comprehensive 
search of the literature to justify the inclusion of 
race as a background characteristic. Instead, we have 
explored methods of recordinq race or ethnic group. 

In the Coleman survey,, race and ethnic group 
were determined by self-response (except in grade 1) 
to three questions as follows (for sixth-graders) : 



4. 


Which of the following best 




(A) 


Negro 




(E) 


White 




(C) 


American Indian 




(D) 


Ot i ental 




(F) 


Other 


5. 


Are 


you Puerto Rican? 




(A) 


Yes 




(B) 


Ko 


6. 


Are 


you Mexican-American? 




(A) 


Yes 




(B) 





In addition, question 3 identifies children born in 
Puerto Rico and in Mexico as a part of a more general 
question concernina place of birth. Responses to the 
questions permit one to separate two important com- 
ponents of the Spanish-origin populations. 

Youth in Transition (1, Volume I) required the 
interviewer to record after the interview his opinion 
as to whether the respondent was white, Nearo or other 
(to be specified by interviewer) . Recording of race 
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by an observer is an error-prone procedure ♦ Also, 
perforr.ance is so hiahly variable for **other*^ that 
it would seen! advisable for NAEP to specify greater 
detail. Finally, the lack of any special treatment 
for Spanish-oriain populations seeips inadvisable for 
NAEP. 

There might be son^e merit in recording race in 
the same m.anner as was done for the 1970 Census of 
Population so that census data might be used for es- 
timation and benchmarking purposes. In the com.plete 
enum.eration the following categories were given: 

White 

Negro or black 

Indian (American) 

Japanese 

Chinese 

Filipino 

Hawaiian 

Korean 

Other (to be specified) 

The detail may be too great for NAEP purposes, but 
might provide a classification that could be collapsed. 

In the five percent sample of the 1970 Census 
a question concernina origin or descent was asked with 
the followina classes: 

Mexican 
Puerto Rican 
Cuban 

Central or South American 
Other Spanish 
None of these 

Also, in the 15 percent sample a question concerning 
lanauage , other than Enalish, spoken in the home was 
asked . 

Finally, for some tabulations for selected areas, 
names were matched aaainst a master file of Spanish 
surnames. If they matched, the record was used in the 
tabulation of characteristics of Spanish-surnam.ed 
persons. This procedure alone does not identify two 
components of the Spanish-^oriain population that are 
of interest, namely the Mexican-American and Puerto 
Rican populations. 
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In Year 01 KAEP obtained information on race by 
having the exercise administrator note race as "black," 
"nonblacki" or "other nonwhite" on the assessment 
package as it was turned in. Science results were 
reported by these categories in Report 7 — both 
balanced and unadjusted results. Race is still being 
recorded in this manner. 

There is little doubt that interest in particu- 
lar ethnic or racial subgroups is so great that NAEP 
v/ill continue to record such characteristics. It 
seer.s advisable to record some additional detail for 
possible future analyses, however • 



2.3.2 Age and Sex 

NAEP is a study of 9, 13, and 17-year-olds, re- 
gardless of the grades in which they are enrolled, and 
of young adults. Thus, age varies only within a 
narrow range, but the grade in which enrolled is a 
variable. The grade in which enrolled is largely a 
function of school policy, but also reflects academic 
progress of the child, parental attitude, student 
health, and other factors. One would expect that the 
greater amount of educational experience of (say) 
nine-year-old students in the fourth grade than of 
nine-year-old students in the third grade would have 
an impact on performance. It seems apparent, then, 
that NAEP should record the grade in which enrolled. 

The age at which the student began the first 
grade might also be a variable with sianificant ex- 
planatory power. (See, for example, effect of age 
for beginning instruction in reading and arithmetic 
on subsequent performance reported in the Plowden 
Report (9, Appendix 10).) In a sense it should be 
better than current grade of enrollment — the latter 
is an outcome measure, not a background variable. 
Coleman asked sixth-graders, "What grade were you in 
last year?" but the responses appear not to have been 
used either by him or Mayeske as backaround variables • 
Questions were also asked to ascertain whether the 
student had attended kindergarten or nursery school. 
Mayeske (32, p. 377) computed averages of the cri- 
terion variable for various responses with respect 
to kindergarten attendance as shown in Table 14. 
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Table 14 • Student averaqes of criterion variables, 

by kindez-crarten attendance Coleman data 



Did Not Percent of 

Attended Attend Variance 

Grade Kindergarten Kindergarten vonresponse Explained 



3 51.3 48.2 45,2 3.2 

6 51.7 48.3 38.1 • 6.8 

12 51.7 48.1 41,7 3.8 



Source: Mayeske (32, Appendix III) 



A clear advantage for kindergarten is demonstrated 
for all three grades, although as usual, the infer- 
ence to be drav;n is not clear. Enrol Irent in kinder- 
garten is, of course, likely to be significantly 
correlated with income, either of the family or of 
the corj^unity. 

Differences associated with nursery-school 
attendance were so slicht that t ley could easily be 
judged inconseauential , 

The international studies have Generally ana- 
lyzed aifferences in aae , but three of their popula- 
tion subgroups (I, II and III), like the NAFP age 
groupings, are students within a one-year age window. 
Thus, differences attributable to aae tend to be 
trivial. Population IV, however, is the group in the 
last pre-colleae year (seniors in hiah school in the 
United States). Kithin this group there is some sub- 
stantial difference in age, and Purves (41), for 
example, found a negative correlation of -0.22 be- 
tween literature achievement score and age for the 
U.S., and he presum.es that "the older student in 
school at Population IV would tend to be the less 
able student who had been held back for som.e reason 
or other . '* 

The NAFF 17-vear-old group is unlike Population 
IV, since aae is held nearly constant. Those^ in age 
group 17 may he cut of hiah school, either by gradua- 
tion or dropout, m.ay he seniors, juniors, sophomores, 
etc, T::us, their crrade :^\ta'K^cy^ is the variable, 



61 



ERLC 



and that is an ::ur-:^o^*'p which presumably could be used 
more effectively if the age of entry into first grade 
was known. Perhaps, an interirediate variable, both 
current grade level and age of entry into first grade 
should be recorded. 

It has been custonary in irost studies of educa- 
tional achievement to record sex of student. In many 
studies, e.g., Mayeske's reanalysis of the Coleman 
data (32, p. 370), relatively small differences are 
noted. His criterion averages are as follows: 

Grade Male Female Nonresponse 



The reversal in sign of the difference from third and 
sixth grade to twelfth grade is a phenomenon that has 
been frequently noted. 

With respect to specific subject matter, however, 
some major sex differences have been noted. Comber and 
Keeves (7, p. 149) showed that at all ages males had 
an advantage in science scores, and that the advan- 
tage increased materially from age 10 to age 14 to 
age 18, The difference was greatest for phvsics and 
least for biology. NAFP found the same pattern for 
science exercises for age groups 9, 13 and 17 and 
found that for young adults the male advantage was 
even greater (Report 7, pp. 35-38). 

Since sex is currently being ascertained by 
\*AEP and since sex differences have been demonstrated, 
at least in exercises related to certain objectives, 
there seers to be no reason why recording of sex should 
be dis ::ontinued • There also seems to be no reason why 
the issue should be arqued further in this study. 



2,3 ,3 Family Structure 

Far.ily structure frequently has been used as a 
background variable to explain part of the variation 
in educational outcomes. Measures of family structure 
that have sometimes been used are absence of either 
or both parents, number of siblings, and birth order 



3 
6 
12 



49.5 
49.4 
50.6 



50.7 
50.7 
49.5 



45.2 
43.3 
^,3.9 
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of the student, Sometin^es if both parents are not 
present in the horr.e the situation is described as a 
"broken horr.e" and has been further classified by cause, 
such as divorce or separation, or death, 

Colenan (5) asked the parental question as 
follows: :'c? KSu jc^tiKg ue i^cur* father (rotker*)? 

I; ted ^ c^CKsidev i^cpur adoptive father 

'-::hev: :.-ur fa-^-he^-* (r.othev)\" Response 

categories for father were as follows (with obvious 
n^.ocUf ications for nothers' responses); 

(A) My real father, who is living at hoire 

(B) My real father, who is not living at home 

(C) My stepfather 

(D) My foster father 
(D) My grandfather 

(F) Another relative (uncle, etc.) 

(G) Another adult 

(H) Ho one. 

Mayeske (32) developed the criterion scales shown 
in Table 15 for the classes of response given above. 
Recall that these scale values are averages of the cri- 
terion for the categories given. It is clear that 
for third and sixth grades a real irother not living at 
hore has a stronaer neoative association with the cri- 
terion than surrogates for the real mother living in 
the hore. The pattern does not hold for twelfth 
graders or for the real father livina away from home. 
Note, in oeneral, the greater association for grade 6 
than for grades 3 or 12, 

Colenan also asked for; 

Nurl^er of people in hone 
Number of brothers and sisters 

Nurber of brothers and sisters older than respondent 
Nuirher of older brothers and sisters who left high 
school before finishing. 

Scales (averages of the criterion-achieverent compos- 
ite) are shown in Table 16 for third, sixth, and 
twelfth grades. 



63 



ERLC 



Table 15. Scale values assigned by Mayeske to cate- 
qories of response to questions concerning 
parents Colerian data 

Grade 



CatecTory 3 6 12 



V:ho acts as father? 

My real father, who is living at 
hone 

My real father, who is not living 

hoir.e 
My stepfather 
My foster father 
My grandfather 

Another relative (uncle, etc.) 
Another adult 
No one 
Nonresponse 

Percent of variance explained 

Who acts as mother? 

My real mother # who is living at 
hone 

My real mother, who is not living 

at home 
My stepm.other 
My foster mother 
My grandmother 

Another relative (aunt, etc.) 
Another adult 
\o one 
Nonresponse 

Percent of variance explained 



Source: Mayeske (32, Appendix III) 



The low averaae scores of students in two-person 
homes probably reflects the effect of a broken home, 
i.e., only one parent present. For all three of the 
grades listed the performance of students with no 
brothers and sisters is below that of students with 
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46 
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43 


.6 


45.0 


44 


.9 


43 


.6 


45.8 


46 


.4 


45 


.5 


46.9 


42 


.9 


43 


.7 


43.4 


4 


.4 


6 


.6 


3.3 


50 


.5 


50 


.9 


50.4 


43 


.0 


42 


.3 


47.1 


47 


.6 


45 


.7 


48.4 


45 


.2 


43 


.7 


45.9 


46 


.2 


42 


.2 


42.6 


45 


.4 


43 


.0 


44 .2 


47 


.5 


40.4 


44.0 


42 


.4 


41 


.2 


46 .5 


42 


.6 


42 


.8 


44.3 


3 


.1 


6 


.5 


1.9 
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Table 16. Scale values assicined by Mayeske to re- 
sponses concerning family size — Coleman 
data 



Grade 



Responses 3 6 12 



Number of persons in the home 

2 44.5 44.8 49.3 

3 52.0 51.0 51.0 

4 52.8 52.4 51.3 

5 52.0 52.4 51.0 

6 50.5 51.0 50.0 

7 48.5 49.4 49.3 

8 47.6 47.5 47.1 

9 45.9 46.2 46.0 

10 45.1 43.9 44.8 

11 or more 46.0 44.5 43.3 
Nonresponse 43.9 42.9 43.8 

Percent of variance explained 6.8 9.0 3.1 

Number of brothers and sisters 

Mone 49.1 49.3 51.0 

1 52.8 52.3 52.4 

2 52.6 52.1 51.9 

3 51.4 50.9 50.9 

4 49.1 49.1 49.6 

5 47.5 47.7 48.3 

6 46.1 45.9 46.5 

7 45.3 44.3 45.3 

8 44.0 42.5 44.1 

9 or more 43.4 41 5 42.4 
Nonresponse 43.0 41.4 43.3 

Percent of variance explained 10.0 8.5 8.1 

Number of older brothers and sisters 

N'one 51.7 

1 50.8 

2 49 .5 

3 47.8 

4 45.7 

5 44.7 

6 43.0 
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Table 16. Scale values assianed by Mayeske to re- 
sponses concerning family size Coleman 
data — Continued 



Grade 





Responses 3 


6 12 


7 




43 2 


8 




42 5 

n 4w • ^ 


9 or 


more 


43 5 


Nonresponse 


4 «) • 4 


Percent of variance explained 


3 • / 


Nuinber 


of older siblings who dropped 




out of 


school 




Have 


no older brothers or sisters 


52 . 1 


None 




50.4 


1 




46.2 


2 




44.0 


3 




43.2 


4 




41.8 


5 




42.0 


6 




42.6 


7 




41.6 


8 or 


more 


42.9 


Nonresponse 


45.5 


Percent of variance explained 


6.8 



Source: Mayeske (32, Appendix III) 



one or two. However, performance drops off sharply 
with four or more brothers and sisters. It is known 
that family size is negatively correlated with income 
The apparent drop in performance with increasing 
nunbers of older brothers and sisters for twelfth- 
graders could be accounted for by the same influences 
that affect neaatively the performance of students 
from larae families. It is apparent, however, that 
there is strong association between performance and 
the number of older brothers and sisters who have 
dropped out before finishing high school, indicating 
the^ influence of intra-family correlations in ability 
attitudes, and so on. 
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Bachn^an in Youtli in Transition (1) considers 
nurber of sihlinas as wexi as whether the home is 
"broken** and whether the horre is broken bv doath or 
by divorce, separation, or sirr.ilar causes". His cri- 
terion is Quick Test scores rather than a measure of 
academic performance, but it is known that the Quick 
Test has m.oderately high correlation with various 
measures of academic performance. He has shown the 
rollcv/inq unadjusted means by various categories of 
intact or broken hom.es (Appendix E) : 

V.ore intact 109.2 7 

Home broken by death 107.' 56 

Hom.e broken by divorce, etc. 104.06 

The unadjusted correlation ratio between status of the 
hom.e and Quick Test scores is 0.14, so that the vari- 
ance accounted for is only about tv;o percent. Thus, 
ona is led to believe that any gain to be achieved by 
aetermining whether the home is broken will be small • 
It is also apparent that if status of the home is 
determined, homes broken by divorce, etc., form a 
separate class and that homes broken by death need 
not be separated from intact homes. 

Bachman also shows the predictability of number 
of siblinas, both unadjusted and after adjustment for 
socioeconomic level (a composite of father *s occupa- 
tional status, parents* education and family 
possessions). Average Quick Test scores are shown in 
Table 17. it is apparent that number of siblings 
contributes somethina to explanation of variance even 
after adjustment for socioeconomic level, although 
the measures used for adjustment are subject to 
error, and the adjustment may be onlv partially 
effective. 

Another way of lookinq at the importance of 
number of siblinas is throuah explained variance. 
Bachman shows the following percentaaes of explained 
variance: 

Explained by socioeconomic level 

^'or.e 19^8 percent 

rxplamen ry socioeconomic level 

and nurLer of siblinas 23.6 percent 
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Table 17. Mean scores on Quick Test, and Quick Test 
net of socioeconomic level, for each cate- 
gory of family size Bachman data 



Family Size 


Mean Score on 


Quick Test Net of 


(Number of Siblinqs) 


Quick Test 


Socioeconomic Level 


0 


111.7 


110.9 


1 


112.8 


111.2 


2 


110.7 


109.4 


3 


108.2 


107.8 


4 


107.2 


108.0 


5 


105.8 


107.4 


6 


102.2 


106.0 


7 or more 


97.8 


102.5 



Source: Bachrrian (1, Table E-4-9) 



Explained by socioeconomic level 
plus number of siblings plus 

race 33,0 percent 

Thus, number of siblings adds 3.8 percent to predict- 
ability after socioeconomic level and race adds an- 
other 9.4 percent. His analysis shows that number of 
siblings accounts for only 1.8 percent beyond that 
accounted for by socioeconomic level and race. One 
must keep in mind that Bachman 's study covers a 
national sample of only tenth-grade boys, hence has 
limited capability for generalization. 



2.3,4 Ability and Educational Achievement 

While it is an accepted truism that ability 
affects educational achievement, the absolute demon- 
stration of this phenomenon has yet to be accomplished. 
All studies attempting to show this relationship have 
used measures of ability that themselves have compo- 
nents of educational achievement. For example, one 
of the individually-administered IQ tests taken as a 
standard, the Wechsler-Belleview , uses educationally- 
influenced measures in developing its index of ability, 
the Intelligence Quotient. As part of its verbal 
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IQ, for instance, it includes a subtest of informa- 
tion, a subtest of vocabulary, and a subtest of arith- 
netic reasoning, all measuring both innate aptitudes 
and learned experiences. 

Further, the nonverbal IQ includes subtests of 
block design, fioure manipulation and sequencing of 
pictures to tell the best story. These subtests are 
again influenced by both innate ability and educa- 
tional or other experiences, as can be seen by the 
types of remedial materials used in programs such as 
I:ead Start. In these proarams, emphasis is placed 
on "play" with form-manipulative materials to in- 
crease discrimination processes, play that is carried 
out in most middle and upper-class homes automatically. 

Hanushek (20) in "The Value of Teachers in 
Teaching" presents a model for testing the effect of 
teachers and says: 

;>:v7:.^ r'n^c? present probably the most diffi- 

cult concept measure in the whole model. in fact, 
it is not well understood how innate abilities 
enter into the educational process, and there is 
considerable controversy over the role of innate 
ability in education. The only consensus that seems 
to exist in this area is that common IQ scores do 
an inadequate job of m.easurinq innate abilities. 

Ke then proceeds to analyze his data, usina progress 
in achievement from an earlier arade as a way of 
"controlling" for differences in IQ. Unfortunately, 
NAEP does not have this alternative open to it, so we 
proceed with reviewing some attempts to use ability 
as a control, recognizing the shortcomings in the 
measurement of ability.^ 

There are mountains of literature on the predic- 
tability of educational outcomes {particularly grades 
and attainment) from, measures of ability (10) . Un- 
fcrtunately, m.ost of this literature is of little 
value to this inves tiaation and we do not attempt to 



Errors in measurement are not unique to measurement 
of ability they are inherent in most background 
reasurements . 
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suminarize it here. Instead, we review some results 
where ability (or IQ) has been considered as only one 
of several background fact:ors used in the explanation 
of variations in outcomes. 

Bachman (1) used a battery of eight ability 
tests on tenth grade boys as follows; 



Matrices 

Gates test of reading comprehension 

Anagrar.s 

Maze tracing 

GATE - numerical 

GATE - verbal 

Hidden patterns 

Job information test 



He also used the Quick Test of Intelliaence and an 
oral paragraph comprehension test and, after some 
analysis, decided to use the Quick Test scores as a 
measure of ability for subsequent analysis. 

In earlier sections we have referred extensively 
to Bachman and have used the Quick Test as a measure of 
achievement. Here we use it in its more traditional 
sense as a measure of ability. This duality of roles 
is inconsistent but useful to the development of the 
measures of association of interest to the study. 

A measure of academic achievement used by Bach- 
man is grades and we consider first the association 
between ability (Quick Test scores) and grades with 
and without consideration of other background factors. 
The relevant data are summarized in Table 18. They 
show that eight backaround factors (without Quick Test) 
account for 11 percent of variation in grades and with 
Quick Test 18 percent of variation, hence an added 7 
percent due to Quick Test. Quick Test alone would 
have accounted for 13 percent of variability. Note 
that Eta2 in the Bachman studies is comparable with 
r (the proportion of variance explained) in other 
studies cited. 

Results were similar for predicting political 
knowledge. Thirteen percent of variation was accounted 
for uniquely by Quick Test as well as by all eight 
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Table 18. Regression analysis of predictability of 
grades from background factors — Bachman 
data for tenth grade boys 



Background Predictors 


Eta 


Eta^ 


Socioeconomic level 
^Nunujer or sioiings 
Broken hom.e 
iam.xj.y reiauxons 
Religious preference 
Family political preference 
v^oiTuuunx ty sxZG 
Race (5 categories) 


0.26 
0.18 
0.]0 
0.21 
0 .16 
0.11 
0 .10 
0.10 


0.065 
0 .031 
0.011 
0 .042 
C.027 
0.013 
0 .009 
0 .009 


Predicting from above 8 characteristics 




0.114 


Predicting from Quick Test alone 


0 .36 


0.128 


Predicting from Quick Test and other 8 
characteristics 




0.184 


Added explanatory power of Quick Test 




0.070 



background factors. Another seven percent of explana- 
tory power was provided by the Quick Test, making 20 
percent of variance explained (after adjustment for 
degrees of freedom) . 

Hauser (21) analyzed data for nearly 17,000 
white public school students in grades seven to twelve 
in Davidson County, Tennessee in 1957. He used two 
measures of academic achievement: 

M Stanford Mathematics Grade Equivalent 
W Stanford Reading Grade Equivalent 

Using regressions within schools (refer to Section 1.3 
for discussion) he found the percent of variation in 
each that could be accounted for by regression. Then 
he added IQ as an explanatory variable and redid the 
analysis. The analysis was accomplished by the method 
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of path coof f icients , but is iMre easily comparable 
with other results in this chapter if put in the 
following form: 

Achievement Test 
M W 

Percent accounted for by: 
Father's occupation 
Father's e.Vucation 

N'unber of siblings 4»1 7.1 

Added percentage due to IQ 28.7 27.3 

Total explained 32.8 34.4 

Again, the contribution of intelligence is substantial. 
It should be noted, however, that restricting the 
study to white students in a single county restricts 
the total variance i'A student scores because of intra- 
class correlations. Therefore, the amount of varia- 
tion explainable by other background factors will be 
reduced and the amount attributable to IQ will be 
proportionately areater. This is particularly true 
when the analysis j.s done within schools. 

McDonald :35) used the Differential Aptitude^ 
Test in conjunction w ^h SES, a measure of motivation 
(M-scale) in the pr3d:c:tion of grade point average. 
He found the followir«j /-esults for the "normal" popu- 
lation, i.e., neitho;- anderachievers nor overachievers : 

Sample (percent accounted for) 

Valida tion Cross Validation 

Males 

SFS and M-scale 0.34 0.35 

Added by D.A.T. 0.34 0.34 



Total 
Ferales 



SES and M-scale 0.24 0.15 

Added by D.A.T. 0.26 0-51 

Total (5T^ 

Aaain, the contribution of ability is substantia] 
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Thus, in spite of the pessimistic note with 
v;hich wo began this section, we have shown that re- 
search has deironstrated son^.e substantial predictability 
or performance frcr. ability reasures. Whether these 
n^easures do, in fact, neasure ability is an unre- 
solved issue, but ray be a hiahly relevant issue as 
far as tiie interpretation of !waEP outcop^'es is concerned. 
That is, if a presured ability measure actually mea- 
sures outcore and NAFP adjusts its ov;n outcome mea- 
sures by the presured measure of ability, it will 
actually be adjustina outcomes by other outcomesi 
makincT interpretation difficult, 

Alan Wilson, in "Social Class and Equal Educa- 
tional Opportunity" ( Harvard Educational Review , Vol. 
38, 1, Winter, 1968, pp. 77-84) (52) discusses the 
uses of ability as a controlled variable iji studying 
achievemer;t . 

In contrasting school environm.ents it is clearly 
necessary to compare students v;ho are similar in all 
relevant ways ... if differences are to be attributed 
to the contrasted schools which they attend 

.Nevertheless, the reasons for not controlling for 
differences in performance on a concurrent ability 
cr IC test score when examininc effects of environ- 
mental variations upon perform.ance are compelling. 
Stanciar:: intelligence and ability tests are mea- 
sures of specific knowledae and problem-solving 
skills whirh have been acquired by the testee 
at scr.e tire prior to the test situation. The 
validity of the IQ test score as a m.easure of 
learnincT "potential" depends upon the assumption of 
equal exposure to and practice with the kinds of 
knowledae and skills that the test calls upon. 
Since the tests v;ere desianed to predict perform- 
ance in school, they call upon the kinds of knowl- 
edae and cognitive skills fnat are required in 
school. Thus the hypothesis under invest iaation 
rust he assured to be false in orcier for this 
central to he valid. 

:ne alternative desicrn to circur.vont this diffi- 
culty v/culd he to undertake a lonaitudin.il study 
c.-rrr^nrin.: children wi'h sirilar r.oabured abilities 
oarlv in -hoir school oaroors wr.o aro subS'j'.Juont 1 y 
jduu to jontrac^ting school oxijor ionco:J . A study 
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usina this strategy was conducted in one community 
after the publication of the Coleman Report and 
substantially confirmed the finding that inter- 
school differences do affect student achievement. 

Our review of the literature is inadequate to 
put any kind of limits on the association of ability 
with achievement, independent of other factors, but 
Jencks (2S) has speculated as shown below. 

The available data sugaest that: 

1. If we could equalize everyone's genes, inequal- 
ity in test scores would probably fall by 33 to 
50 percent. 

2. If we could equalize everyone's total environ- 
ment, test score inequality would fall by 25 to 
40 percent. 

3. If we merely equalize everyone's economic status, 
test score inequality would fall by 6 percent or 
less . 

4. Equalizing the amount of schooling people get 
miaht reduce cognitive inequality amona adults 
by 5 to 15 percent, although this estimate is 
very rough. 

5. Equalizing the quality of elementary schools 
would reduce cognitive inequality by 3 percent 
or less. 

6. Equalizing the quality of high schools would 
reduce cocnitive inequality by 1 percent or 
less . 

7. Elirinating racial and socioeconomic segregation 
in the schools miaht reduce the test score gap 
between black and "white children and between 
rich and poor children by 10 to 20 percent. 

8. Additional school expenditures are unlikely to 
increase achievem.cnt , and redistributina re- 
sources will not reduce test score inequality. 
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It is obvious that there are substantial prob- 
ler.a in separating performance and ability. These 
prc;bler,s are accentuated when one considers popula- 
tion subcroups that have, for a variety of reasons, 
suffered sortie forn of educational disadvantage, 
Further, the problems of adiPinisterinq any kind of 
ur.iforr.ly interure table ability tests within the 
N7\EP testing environr.ent are nontrivial. The recent 
Anchor and Equatinq test project nay provide a 
partial solution, but there seem to be persuasive 
arguments against atterptinc to adjust individual 
exercise P values for differential abilities. 



2.4 School Variables 



2 ,4 ,1 Introduction 

Many studies have investiaated the relationship 
of school (or school district) variables to perform- 
ance r.easures. In some studies school characteris- 
tics are treated as independent (or classification or 
regression) variables in an effort to understand the 
extent to which such variables, along with others, are 
associated with, or can "explain," t>:d: [iu^l etuder.t 

In others, school (or distiict) averages 
or characteristics serve as the background or other 
independent variables to "explain" .7 i er ^^cv'^.nKoe 

;* * y , The motivation of 

studies of either type has som.etimes been to examine 
the association between outcomes and seqregation or 
integration and sometim.es to identify various types 
of schccl or school district characteristics or 
practices that are consistently associated with high 
performance, in an effort to evaluate and improve 
educational practices and systems. Like other vari- 
ables, sore of the school (or district) variables are 
subject to school or educational system control and 
ranipulaticn , and others are backaround variables 
that are not subject to control, at least on a short- 
run basis. 

For some variables the school or the school 
district is the unit for which relevant information 
IS available and consequently is the natural unit to 
be used. The school is a natural unit for such vari-* 
ables as pupil-teacher ratios, size of school, and 
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nany others. The district is a natural unit for 
factors related to finance: cost per pupil, average 
teacher salary, and so on, although such data are 
soir.etirr.es available or can be approximated for 
individual schools . 

Another set of variables can be associated with 
either the school or the district, such as median in- 
come of family, percent of population in specified 
racial or ethnic groups, average educational attain- 
ment of the population, predominant occupations, and 
so on. If they can be shown to serve as useful back- 
ground measures, characteristics of the comjriunity rep- 
resent a potentially useful set of variables for NAEP. 
They often can be obtained from secondary sources such 
as the Census reports, the reports or records of the 
\'ational Center for Educational Statistics, the Office 
of Civil Riahts, and other sources. The National 
Center for Educational Statistics has created a school 
district data base from, the 1970 Census returns for 
small areas which can supply approximate Census data 
at the school district level. This data base should 
be especially useful in studies in which the school 
district is the unit of analysis. 

Still another set of variables is associated 
with the student, but can be averaaed over the stu- 
dents in a arade within a school or over the school 
district, or over the students in a given age or age 
group in a school or district, to create a school 
variable. An example of an outcome variable of this 
type is average achievem.ent test score for all stu- 
dents in a particular grade level oi other specified 
group in the school (or district). Exah.ples of such 
backcrround variables are averaae measures of pupil 
ability, average education or occupational score of 
pupils' parents, or average score for educational 
m.aterials in the home* These variables may be re- 
lated either to the specified grade or other sub- 
classes within a school, or to the total school or 
school district • Note that the characteristic that 
distinguishes these variables from those in the pre- 
vious paragraph is that here wo are concerned with 
the average for the student body while in the pre- 
vious paragraph we are approxim.a tina the attendance 
area. Vhe attendance-area variables frequently can 
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be obtained from secondar\ sources, while the student 
body variables must be obtained frorr the pupils then)- 
selves, or froni their pararts, or froir school records. 

ether school variables include the characteris- 
tics of a student's teacher in a subject or a class, 
the r.ethod of teaching in the particular class, and 
related variables often determined by the particular 
school class or classes that the student has taken or 
is taking. In this discussion we shall reaard such 
variables as sinply individual student characteristics, 
but because they are associated with the school we 
shall refer to therr. as student-linked school variables. 
As indicated earlier, our principal concern in this 
section is with school-wide variables, although some 
brief consideration will be given to student-linked 
school variables. 

We Can sumir.arize our pragmatic classification of 
variables considered in this chapter as follows: 

• School district variables -- expenditures per 
pupil, average (or m.edian) teachers' salaries, 
average (or m.edian) income, total pupils, 
average annual expenditures for plant and 
equipment, etc., for the school district 

• School-linked (or school-wide) variables — 

.\ :.^''^:.->'^: average (or median) in- 

core, percent nonwhite, etc, for school 
attendance areas 

* r — school averages of 

student body characteristics, sex, aae, and 
racial distribution of teachers, kind of 
school (academic/vocational, etc.) average 
characteristics of families of students etc , 

• Student-linked school variables — Curriculum 
in which enrolled, characteristics of class- 
rocr or subject-matter teacher (of the indi- 
vidual student) , etc. 

One of the questions which arises in the adjust- 
rent of student outcoro data is how specific to the 
individual stuctent the backaround data must be in 
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order to be useful for adjustment purposes* For ex- 
arrple, in Section 2.2 it was shown that father's occu- 
pation and father's educational attainment were 
useful explanatory variables in the measurement of 
ourcor.es. 0:ie can ask the students in the upper 
qrades and the teachers of students in the lower 
grades for this kind of information. However, for 
younoer students, at least, one must assume there is 
sere substantial error in student reporting of either 
occupation or education. Finally, there has been 
resistance in sor.e jurisdictions to permitting students 
to report characteristics of their fam.ilies on the 
>::rounds of invasion of privacy. 

A key question is whether, if one did not have 
these parental characteristics for individual child- 
ren, the average educational attainment of adults and 
the occupational distribution within the school 
attendance area would be meaningful codes to attach 
to the individual students' records for adjustment 
purposes. And, if such data are not available by 
attendance area, could school district or county data 
be used instead? Indeed, since occupation is used as 
a surrogate for incone, m.ioht one reasonably use median 
income for the smallest geographic unit encompassing 
tho attendance area for which such data are reported? 

The answers depend upon the relative importance 
of cor.Tunity variables as contrasted to individual 
student: backcround variables in the explanation cf 
variance, and upon the proportion of the total variance 
in individual student outcome variables that is ac- 
counted for by the variability between school means, 
\*ct all of the ans^t^rs will emerae from, the analysis 
t^.at follows, but ir. the analysis we will be aware of 
the need to answer such questions. 

v;e now turn to a very brief consideration of 
student-linked school variables, and then to an ex- 
ar.ination of the use of school-linked and dii:itrict 
variables in the analysis of individual student charac- 
teristics. Following that, we present the use of 
school-linked or district variables when the school 
or school district is the unit of analysis. 
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2.4.2 Student-linked School Variables 



As indicated above, student-linked school vari- 
ables relate to individual teacher, class, or other 
school characteristics associated with the individual 
student. Such variables presumably are subject to 
school or oducat'onal systen control. 

Pew large studies have investiaated the associa- 
tion between achiever.ent and the v/ithin-school environ- 
r.snt surrounding the individual student. Most larae 
studies have considered the entire school as furnish- 
ing the environment within which the child learns. 
Since this literature review, by desian, has given 
prjr.ary attention to larae scale studies, we have un- 
doubtedly n^issed sore snaller scale, but irr.portant, 
studies of within-school relationships. 

However, one of the student-linked school vari- 
abler that has been extensively studied is the racial 
composition of the class (not the schools) in which 
the student is enrolled. For example, McPartland (36) 
m a study of 5 ,075 ninth arade N'earo students in 
New England and the Middle Atlantic states showed that 
the racial corposition of the class was an iirportant 
factor in explaining individual student achieverr.ent , 
recrardless of the racial corposition of the school or 
the teachina syster (if any) erployed by the school. 

Another student-linked variable that has re- 
ceived considerable attention is class size, ^urir.o 
and Cciiins (17) in a study of Baltir.ore DUblic 
schools controlled on (1) parentis occupation, (2) in- 
tellicence test score, (3) type of curriculur and 
(4) race. They concluded that there was a sionificant 
advantage shown in favor of smaller classes. Studies 
usincT the entire school as the unit of analysis (e.a., 
t:;e Ccleran studies) have found less sianificance in 
class size , 

A student-linked variable that we were surprised 
not find in any of the larcre scale studies we're- 
.'iowod is any characteristics of the classroorr (or 



subject-r.attcr) teacher that can be linked to the 
individual student. Mood (50) identified six cate- 
gories of teacher variables as follows: 

1. Dedication to the educability of all children 

2. Ability to communicate 

3. Ability to motivate 

4. Ability to organize and manage a *:lass 

5. Ability to create learning experiences 

6. Knowledge of a chosen field in which to teach 

Variables of the kinds identified above related 
rore to the process Df education than to background. 
There are also nontrivial problems of measurement in 
trying to use them, Furtherm.ore , a student's perform- 
ance in a given year reflects his associations with 
teachers over a period of years, so that the charac- 
teristics of teachers in the entire school may, in 
fact, be a better measure of background (for the 
purposes of National Assessment) than characteristics 
of the specific teacher with whom the student has 
daily contact. This is not to say that it has equal 
. • ^ power. 

2.4.3 School-linked (or School-Wide) Individual and 
Student Outcone Measures 

It is the association of school-wide variables 
with individual student outcome measures that is of 
principal concern to NAEP . 

Sor.e analyses of special interest in connection 
with unders tandina and estinatina the proportion of 
variance in individual student achievement or other 
outcore measures that can be associated with school- 
wide variables are given by Mayeske (31), by Marshall 
Sr^ith (37), in Mosteller, Moynihan, et. al, by Purves 
(41) and by Husen (26) . 

Table 19, fr-or Mayeske (31) shows, for Coleman 
study data, and for selected variables, the percent of 
the tctal individual student variance in achievement 
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tihat is associated with the schools that students 
atto:u:. This percentage represents the upper limit 
for the percent of achieverent variance that can be 
associated with school-wide measures, either taken one 
at a tir.e or throuah multiple regression. Thus, as 
indicated by Mayeskc, no more than approximately 37 
percent of the total achievement variance of the 
students in the ninth-arade level can be accounted 
for by correlating school-wdc'.e variables, such as 
schcoi averaaes for. student and teacher characteris- 
tics, with the individual achievem.ent scores. 

Table 19. Percent of total variance for different 

student variables that is associated with 
the schools students attend — Coleman 
data 



Grade Level 



'.'ariablG Title 


12 


9 


6 


3 


Sec ice Conor ic Status 


27.67 


33 .09 


28.05 


39.98 


Far.ily Structure and 










Stability 


12 .20 


18.06 


18.05 


24.10 


Racial-Ethnic Group 










y.errbership 


68.97 


68.58 


55 .54 


59.62 


Achiove.rent 


34.04 


36 .68 


35.48 


35.6 3 


Attitude Toward Life 


15 .89 


21 .77 


13.26 


9.10 


Expectations for 










Excel lencG 


6.10 


11 .00 


9.90 


15.13 


Educational Plans and 










Des i res 


10.12 


11 .26 


12.38 


9.92 


Study iiabits 


11.31 


18.40 


15.04 


19.41 


?."urber of Sc'r^ools 


780 


923 


2, 372 


2,453 


N'urber cf ?*"uce'^ts 


?6 ,409 


133,136 


123 , 386 


129,774 


Source: yayesi-'.e (31, 


Table 4 


.2) 







Between-schcol variances are quoted by Marshall 
Sr.itr., dcrair. with Cclcr.an data, but usinc: only the 
.:ata fcr r.crthern Blacks and Whites, and usina the 
ir.;:ividunl verbal achieverent scores as the dependent 
varia:. lo. He aets t;:e results shown in Table 20 for 
Letwoor.-scr.ocl '/ariar.ces as a portion of the total 
variance cf individual achieverent scores. These 
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proportions are considerably lower than those from 
Xayeske in Table 19 as is to bo expected in a re- 
striction of the universe of analysis. 

Table 20. Percent of total var'.ance in individual 

verbal achievement scores that lies among 
schools* 

Level 



12th 9th 6th 3rd-^ 1st 
Grade Grade Grade Grade Grade 



\--rthern Blacks 10.92 12 .67 13 .89 19.47 10.63 
::crthern Whites 7.34 8.69 10.32 11.42 11.07 



* Fror. Table 3.22.1 of the EEOS Report. 

The Srd-arade verbal test was unreliable (see 
Jencks, Chapter 4). 

Scurce: Srith, in Mosteller and Moynihan (37, 
Chapter 6 , Table 4) 



Purves Ml) reported for the U.?. sample the pro- 
portion of total student variance in liiierature scores 
accounted for by between*-school variance as follows: 

14-year-olds 25 percent 

Hiah school seniors 17 percent 

The results are important here to illustrate the upper 
lirit of v;hat can be accounted for by school-wide 
variables in particular cases. Of course ; the pro- 
portion of variance accounted for by between-school 
'^cr school-district) r.eans is a function of the ex- 
tent to v;hich there is an intraclass correlation among 
studt^nts within a school on perforrance or outcome 
reasures. The intraclass correlation is approximately 
euual to the crocortion of variance that is accounted 
for by between-school variance . 

The variance of individual student scores will 
he larirer than that of school means, for any variable. 
Moreover, the variance of school m.eans ordinarily will 
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be larqer than the variance of school district means, 
5nsl these, aaain, will be laraer than those of county 
r.ear.s. This i^ not a r.atherratical statement, but it 
is corrronly observed to be true and will be true in 
qenerwU when there is a positive intrac.lass correlation 
aror.a students within a school v;ith resi^ect to whatever 
variables are under examination, and, similarlv, v;hen 
there is a positive intraclass correlation ar.ona 
schools within a school district, or amonq districts 
within a county. There are rational reasons to expect 
that these correlations will generally (althouah not 
universally) be positive. They will be positive when- 
e\'er the units arouped into a hiqher-level unit (e.g., 
students within a school or schools within a district, 
c*- students within a district), tend to be more alike 
than any pair of units selected at random from the 
whole universe of such units. The >-esults of many 
analyses suggest that such positive intraclass cor- 
relations do, in fact, describe what has been rather 
widely observed (17, Vol. I, p. 307). 

We turn now to reportina some illustrative re- 
suits of the proportion' of total individual-student- 
score variance accounted for by school variables. 

The Coleman study (5) focused directly on the 
issue of the association between rchool variables and 
outcomes within specific combina J: Ions of ethnicity 
and rccricn. However, Colem.an used verbal ability mea- 
sures rather than a m.ore direct measure of performance 
as a criterion or dependent variable, partly on the 
grounds that (1) between-school variances were maxi- 
mized by this measure, and (2) between-school variances 
persist^ throuah the twelfth arade rather than decline 
as in the case of a performance measure. He points 
cut that the verbal ability test is in fact a verbal 
achievement test and, in fact, uses "achievement" to 
denote it in the analysis. Even so, for our purposes, 
a --ore cutcome-criented m.easure of performance would 
seem to be closer to N'AFP exercises than a measure of 
alility, and the decline in association throuah the 
upper trades (if this phenom.cnon in fact obtained for 
NAKP^ should be reckcnod with. 
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Colerunn adjusted verbal ability scores of in- 
dividual students for school background measures after 
first adiustinc: them for the following individual 
students' backuround factors: 

Cb jective Measures 

A, Urbanisr. 

Parents' education 
C. Structural integrity of the home 

Soilness of family (number of brothers and 

sisters) 

i:, Iter.s in home {TV, telephone, record player, 
refrigerator, automobile, vacuum cleaner) 

F, Reading material in home (dictionary, encyclo- 
pedia, daily newspaper, magazines, books) 

Subjective Measures 

G • Parents * interest 

H, Parents' educational desires 

There are some differences in items included and 
sources of the data over the three grades studied, 
sixth, ninth, and twelfth. Most of the relevant 
analysis controls on the six characteristics A through 
r above. That is, subsequent analysis is done on the 
residual of the performance measure from the linear 
regression cf performance on these six variables. 

Table 21 shows the amount of the total student 
variance accounted for by the six individual background 
factors separately for specified subaroups of the ^ 
population, and for each of three grades. There is 
evidence that associations with the student back- 
vTrcund factc^rs decline from sixth to ninth to 
twelfth arade, possibly because of dropouts, thereby 
increasinc hor.oaeneity among those in the higher 
cTrades, It is also evident that the backaround 
factors are relatively unimportant in accounting for 
variation in outcom.e amona northern Nearoes and rela- 
tively irijortant am.ong southern Negroes and Indian- 
Ar;.cr icar.s , 

The proportions of individual-student variance 
acccv.nted for' by school characteristics after adjust- 
ment :cr the six backaround variables given above are 
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Table 21. Percent of total student variance in verbal 
achievor.ent accounted for at Grcides 12, 9, 
and 6, by six individual student background 
factors — Coleran data 



Grade 





12 


9 


6 


Puerto Ricans 


3.64 


3.89 


23.71 


Ind i 3r — Ape r i c^i r c; 




J. J , J? ^ 


io . 4U 


Mexican-Aire ricans 


7.92 


12.79 


21.82 


NocrO; South 


14.11 


12.27 


14.66 


Negro, North 


7.53 


7.68 


9.51 


Oriental-Ane ricans 


11.81 


12.75 


34.77 


White, South 


14.75 


18.40 


18.14 


v;hite, North 


14.28 


16.49 


14. in 


Negroes, Total 


13.48 


12.15 


14.01 


Whites, Total 


14.71 


17.81 


16.20 



Source: Colenan (5, p. 300) 



given in '^able 22. The variability of the percentaaes 
ever the population subaroups is considerable. Again, 
the association is relatively large for southern Ne- 
groes and Indian-Ar.ericans . However, note *'hat the 
effect of school variables does not appear to decline 
fror the third to twelfth grade, but rather to 
increase. 

Coler.an's assessrent of the importance of school 
factors has been criticized (^ee Mosteller, Moynihan 
et. al. (37)) on the arounds that adjustnient for 
student backaround factors first actually adjusts for 
part of the school factors, because, of the correla- 
tion between student background and school factors. 
Marshall Srr.ith (37, Chapter C) gives an extensive 
analysis of the effects of thre^ qroups of school- 
wide variables, alona with individual here background 
variables, in accounting for che variance of verbal 
achiever.ent scores for sixth-arade Northern whites. 
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Table 22 • Peret^nt of variance ih verl)nl achievement 
of individual students accounted for by 
school characteristics after control for 
individual studen**. background characterise* 
tics Coleii^an Data 



Grade 





12 


9 


6 


3 


Puerto Rlcans 


6 .67 


4.07 


3.21 


2.27 


Indian-Americans 


11.48 


2.59 


5.64 


4.04 


Mexican-Americans 


6.59 


2 ,82 


1.47 


3.50 


Negro, South 


8.64 


7.52 


4.90 


0.80 


Negro, North 


3.14 


1.45 


C.77 


2.96 


Oricntal-An^oricans 


3.83 


5.66 


9.06 


2.62 


Whites, South 


3. ,16 


1.60 


0.57 


0.83 


Whites, North 


1.87 


0. 73 


0.32 


0.33 


Negroes, Total 
Whites, Total 


6.96 
2.53 


5.19 
1.15 


2.77 
0,47 


2.26 
0.33 



School characteristics are: 



Per pupil expenditure on staff 
Volumes per student in library 
Science lab facilities (9 and 12 only) 
Extracurricular activities (9 and 12 only) 
Presence of accelerated curriculum (9 and 12 only) 
Comprehensiveness of curriculum (9 and 12 only) 
Use of tracking (9 and 12 only) 
Movement between tracks (9 and 12 only) 
Size 

Guidance counselors (9 and 12 only) 

School location (city suburb, town, country) 



Source: Coleman (5, p. 306) 



Table 23 shows a list of variables used, and simple 
correlations with individual student verbal achieve- 
ment, along with means and standard deviations for 
each variable. All of the variables except the home- 
background factor are school-wide variables (fuller 
definitions of the individual variables are given in 
(37) beginning on p, 321) , 
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Tablo 23i Mean«, standard deviations i and standard- 
ij^oct recfression co€?f f icients for selected 
independent variables in a number of re- 
viression equations with Verbal Achievement 
as the? dependent variable sixth grade 
northern Whites 

Zero- 
order 



Variable 






r with 


Mean 






Homt? Rackcrround Factor 








3 Reading Material 


0.293 


0 .510 


0.2 •!• 


4 Items in Home 


0.311 


0 .340 


0 22-h 


5 Siblings 


0.241 


0.758 




6 Structural Integrity 


0 ,236 


0 .580 


0 . 11 I' 


39 Parents* Education 


0,277 


0 .877 


0.28 + 


40 Urbanism of 






Background 


0 ,067 


1.242 


-o.iot 


Facilities and 








Curriculum Factor 








38 Per-Pupil 








Expenditure 


492.614 


174 525 


0 04 


2 3 Volume Student 


4 687 






9 School size 


80.215 


47.606 


0.01 


2 3 School Locution 


3.654 


1.745 


-0.00 


37 Promotion Slow 








Learners 


2.096 


1.451 


-0.03 










Curriculum 


3.074 


1.165 


-0.03 


Student Body Factor 








10 Proportion Own 








Encyclopedia 


0.807 


0.113 


0.21t 


26 Student Transfer 


7.50'/ 


6.501 


-0.00 


31 Attendance 


91.132 


2.520 


0.08t 


55 T Perception of 








Student Quality 


-0 .135 


0.423 


-0.23t 
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Tv'^blG 33, MOvinS; st^mdard deviations^, and standard*- 
ized rocTri^K^sion coefficients for selected 
indopondont variables in a nuinhcr of re- 
arossion equations with Verbal Achievement 
vis the dependent variable - sixth yrade 
northern Whites Continued 



Zero- 
order 
r with 





Variable 


Moan 


S.D. 


Verbal 


Teacher Chnracte.risticB 








11 


T SES Level 


3.729 


0.634 


0.07* 


12 


T Kxperienco 


11.736 


4.561 


-0.01 


13 


T Localism 


0.055 


0.796 


0.07* 


15 


T Dotjree Receivod 


3.022 


0.317 


0.05 


16 


T Preference for 










Middle Class 


-0 .240 


0.712 


-o.iot 


17 


T Verbal Score 


23.341 


2.063 


0.05 


18 


T Prop. White 


0.965 


0.074 


0.09t 


48 


Prop. School White 


0.877 


0.143 


0.16t 



Significant at the 0.05 level 
significant at the 0.01 level 

Source: Smith (37, Chapter 6, Table 3) 



Table 24 shows the percentages of total variance 
of individual verbal achievement scores that are 
accountied fcr by the three sets of school-wide groups 
of variables, showing the share of the total variance 
that is accounted for by each group of variables 
individually, and the joint contributions. The four 
objective backqround controls are: Home Items, Read- 
ing Items, Number of Siblings, and Structural Integ- 
rity of Family. The two subjective controls are: 
Parents* Educational Desires and Parents* Interest in 
Child's School Experience. 
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Tabio 24 • Porc^nta^jas of total variance of indi- 
vidual vorbal acliievument scoiros for 
three sets of schoclwide influences 
(Student Body, Facilities and Curticulum^ 
and Teacher Characteristics) - sixth grade 
northern Whites 

No Rack- 





With 




cf **oiind 




ctround 


Control R 






1 


2 


3 




(4 obj., 








2 subj.) 


(6 obj.) 




nuucieriu tiouy unitjuexy 


1 . yo 


1 . 10 


<i . 32 


Facilities and Curriculum 








Uniquely 


0.31 


0.24 


0.22 


Teacher Characteristics 








Uniquely 


0.55 


0.46 


0.53 


Student Body and Facilities 


0.00 


0.01 


0.16 


Student Body and Teachers 


0.96 


0.41 


2.01 


Facilities and Teachers 


0.07 


0.08 


0.00 


Student Body and Facilities 








& Teachers 


-0.09* 


-0.09* 


0.06 


Total 


3.78 


2.22 


7.35 



The negative signs indicate that the total variance 
explained by all three variables together is greater 
than the sun of the amounts of variance explained by 
the three variables separately and in pairs. This 
reflects the fact that some of the factors are 
neaatively correlated with one another. 

Source: Smith (37, chapter 6 Table 2) 
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In the International Study of Achievement in 
Ma thernaticS i (26) as anothex-* illustration , a numbei: 
of variables were used^ as follows: 

Parental Variables 

Mother's education 
Father's education 
Father's occupation (status) 

Father's occupation (iicientific or nonscientif ic) 
School standard deviation in Father's occupational 
status 

Place of parents' residence 

Teacher Variables (School-wide) 

Student's opportunity of learning the test items 
Description of mathematics teaching and school 

learning 
Length of training 
Sex of teacher 

Recent in-service mathematical training 
Degree of freedom given to the teacher 

School Variables 

Number of weekly hours of mathematics instruction 
Number of hours in the school week 
Number of hours of mathematics homework in the 
week 

Number of hours of all homework in the week 
Total roll of school 

Percentage of men teachers on the school staff 

Educational differentiation 

Number of subjects taken in grade 12 

Number of subjects taken in grade 8 

Cost per student in teacher's salaries 

Student Variables 

Sex of student 
Age of student 

Student's level of mathematical instruction 
Student's interest in mathematics 



90 




The teacher variables" are based on the charac- 
teristic^ ctnd perceptions as reported by the stud^nit^s 
mathematics teachers. Some results from the study for 
these variables are summarized in Table 25 ♦ These 
data are for the rational sample of U.S. students at 
the level indicated. 

Table 25. Kstimated simple correlations of individ- 
ual teacher characteristics variables with 
mathematics test score 

High School 
Seniors with and 
without Mathe- 
matics Emphasis 
13- in Hicrh School 

year- ^ 
Variable olds With Without 



Sex of teacher 


0.01 


-0.05 


0.01 


Length of training 


0.08 


0.15 


0.03 


Recent in-service 








mathematical 








training 


0.10 


0.10 


0.02 


Degree of freedom 


0.03 


0.03 


0.00 


Description of 








teaching 


0.02 


-0.02 


-0.09 


Student ' s 








opportunity 








of learning 


0.19 


0.29 


0.04 


Source: Husdn (26) 


Vol. II, 


Tables 6.6, S.8, 


and 6 . 9 



It is seen that the simple correlations with 
mathematics test score are all relatively low^ 
although they are somewhat higher for the seniors 
with mathematics emphasis in high school. This is 
particularly true for "length of training" and "re- 
cent in-service mathematical training." "aIso^ the 
correlation of the teacher's report of student's 
advance opportunity of learning the mathematics con- 
tent is relatively high for the 13-year-olds^ and for 
the seniors with emphasis in mathematics. 
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Measures of the joint effect of these teacher 
vaeiaMer, are also given in the study, in the form 
of the proportions of the total variance (r2) that is 
accounted for by this particular group of variables in 
the nmltiple correlations. These are given in 
Table 26, 

Table 26* Percent of the variance accounted for by 
the group of teacher variables in Table 
25 when analyssed in combination with a 
nuntber of other variables 



Percent of Total Variance 



Same but 
With All Listed Excluding 
Variables (Plus Student's Op* 
Others) in Mul- portunity of 
Student Population tiple Regression Learnincj 

13-year-olds 2.6 0.5 

Seniors 

With Mathematics 

Emphasis 4.8 1.3 

Without Mathematics 

Emphasis 3.8 2.8 



Source: Hus^n (26) Vol. II, Tables 6.6, 6o8, and 6.9 



It is important in interpreting these contribu- 
tions to total variance to be aware that they come ^ 
fror a multiple regression analysis, and the contri- 
bution of these particular variables will be a func- 
tion of what other variables are al^o included in the 
regression analysis. The other variables include: 

a. Five variables representing parents' charac- 
teristics and including mother's and father's 
education, father's occupation (and whether 
it is a scientific occupation or not), and 
place of residence of parents. 
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h. SiK student variables includinq sex and age, 
ntudont'a lovel of niatht^maticai instruction, 
and student's interest in mathematics. 

c. Ten school variables including averages for 
weekly hours of mathematics instruction, 
hours in the school week, school size, 
percentage of teachers male, number of sub- 
jects in grade 12, number of subjects in 
grade 8, and cost of teachers' salaries per 
student • 

It should be especially emphasized that Table 26 
does not represent the added contribution of these 
variables to variance accounted for, in a stepwise 
regression approach, but rather their share ^ of 
the total variance accounted for in the particular 
regression equation. Multiple regression and multi- 
ple correlation measures of variance contributiions 
for subsets of variables are difficult to interpret 
because results for any particular variable or subset 
of variables depend on the other variables involved, 
and in some instances, on the order in which the 
variables are introduced. Usually the square of the 
simple correlation coefficient between a specified 
variable and the dependent variable shows the upper 
limit of what the specified variable can account for 
in proportion of variance, no matter what other vari- 
ables are introduced, although in certain special 
cases this may not hold. 

The simple correlations of the specified school- 
wide variables with mathematics scores are given in 
Table 27. It is seen that only a few of the correla- 
tions are of any consequence in terms of their poten- 
tial for accounting for variance by themselves. The 
fraction of total individual-student mathematics score 
variance accounted for in a multiple regression 



^ Obtained by summing br for the specified variables 
from the regression equation, where r is the simple 
correlation coefficient of the indicated variable 
with the dependent variable, and b is the corres- 
ponding standardized regression coefficient. See 
(26) , p. 261. 
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invokincj all variablos listed earlier is given in Table 
28. It ii^ seen that school-wide variables arc more 
effective for seniors than for Ti-year-olds , and 
apparently more effective for the mathematics seniors 
than for the other seniors. Note, however, that the 
school-wide variables are tailored for their associa- 
tion with mathematics scores. The proportions of 
variance accounted for in the multiple regression by 
all the school-wide variables combined is not 
large • 

Table 27. Simple correlations of school-wide vari- 
ables with individual-student mathematics 
scores, for the U.S* sample 



Simple Correlations For 





13- 








year- 


Mathematics 


Other 


School-wide Variables 


olds 


Students 


Students 


Time for all schooling 


-0.04 


-0.16 


-0.14 


Time for all homework 


0.14 


0.22 


0.17 


Time for instruction 








in mathematics 


0 .02 


-0.22 


-0.08 


Time for mathematics 








homework 


-0.01 


0.09 


0.05 


Total role of school 


0.06 


0.32 


0.27 


Percentage of male teachers 


0.01 


0.04 


0.07 


Number of subjects in 








grade 8 


-0.03 


0.01 


0.01 


Number of subjects in 








grade 12 


0.01 


0.10 


-0.14 


Cost per student 






0.08 


(teachers' salaries) 


0.10 


0.07 


Educational differential 


-0.01 


-0.18 


-0.16 



Source: Husdn (26) Vol. II, Tables 6.14, 6,16, 6.17 



Mayeske in A_ Study of the Achievem.ent of Our 
Nation's Students "T33) , again using Coleman data, 
has shown that about 4 8 percent** of the variation in 



*• Figures are read from Mayeske 's 'jraphs and are 
subject to some error. 
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Table 23. Fraction of total individual student 

niathemtttics score variance accounted for 
by specified aroupa of school-wide vari- 
ables, in a multiple regression with 
additional variables, for the U.S. sample 



Seniors 



Groups of 
School-wide Variables 


13- 
year- 
olds 


Mathematics 
Students 


Other 
Students 


First group of four 








variables listed in 








Table 27 


2.1 


3.6 


1,3 


Other school-wide variables 


0.4 


6,2 


5.3 


All school-wide variables 


2.5 


9.8 


6.6 



Source: Husen (26) Vol. II, Tables 6.14, 6.16, 6.17 



individual student achievement can be accounted for 
by home background, race (ethnic group), and a moti- 
vational factor which he id<=^ntifies as Family Process, 
Home background includes socioeconomic status and 
family structure and stability. Family Process in- 
cludes students' reports of parents' expectations 
for excellence, attitude toward life, educational 
plans and desires, and study habits. About 37 per- 
centage points of the 4R percent accounted for by 
home background, race and family process are accounted 
for by home background and race alone. 

If we take the approximately 37 percent of vari- 
ance accounted for by home background and race/ 
ethnicity as a base, the key question as far as this 
study is concerned is how much additional explanation 
in variation of individual student achievement can be 
obtained by adding school factors. Unfortunately, 
Mayeske's analysis does not provide exactly the answer 
we need. First, he added family process to home back- 
ground, so that we work from a base of 48 percent 
rather than 37 percent. Second, he included in school 
variables average student body (1) expectations for 
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e.xcell^nce, U) :ittitucle toward life^ (3) educational 
plans and desires, (4) study hnbitc, and (5) 
w^chievement ♦ The first four of thene variables are 
included in family backciround, as individual student 
characteristics, and the fifth is the average of the 
criterion for the school. Thus, the amount of addi- 
tional variance explainable by school factors (as con- 
trasted to average student-body characteristics) is 
difficult to ascertain. 

However, he shows that the total variation ex- 
plained was 54 percent, so that the additional amount 
Dxplained by school factors must be no greater than 
54-48, or 6 percent. Note again that this does not 
argue that school- factors are unimportant since, as 
demonstrated earlier, they are highly interlocked 
with student characteristics. 

Mayeske has been able to explain more of the^ 
total student variation than most other major studies. 
He sorteu wluougii a large number uf possible back- 
around variables and used criterion scaling. Both 
techniques tend to produce levels of association that 
cannot be achieved on an independent set of data. 
However, the smallest racial/ethnic group studied 
by him was Orjprtals and even for that group he had 
1,675 students in the ninth grade, approximately 
equally divided by sox. Indians were represented 
by 2,877, Mexican-Americans by 5,836, Puerto Ricans 
by 3,702, and Negro by 37,26 5 ninth graders. He 
covered first, third, sixth, ninth and twelfth grades, 
so for some analyses the samples were about five times 
as large as the above figures. Thus, while his fig- 
ures miaht not be duplicated by an independent set of 
data, they must be taken seriously as representations 
of the predictability that can be achieved with a 
large number of background variables. 

One of the principal criticisms of the study is 
that the data are old, having been collected prior to 
the massive efforts to balance racial groups within 
the public schools. One must presume that this effort 
i^' would have some effect upon the explanatory power of, 

say, racial distribution as a background variable. 
It must also have had some effect upon the homogeneity 
of school attendance areas and even the ability to 
define such areas. 
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bofom Uuivinu thv. Colcnu\n Htiuiy niui it-s? do- 
iriv;»t,ivo«, \.l\K\ wAf!>pjo corruil^itdons found bv hSm 
between "wrbal poah?" and i4ok>ctiHl i-.ohoor f actorw 
:;uiy bo wo r til not.invt. 'I'iiov aro s^unwari-^fc'l for throo 
rcuUsil-ofchnic urours ani? for urailos 6, 9, and 12 in 
Table Tho variabUns aro acscribod moro completely 

in tho Oolonian report (5) and it^3 supplemental appon- 
:\in (6), Tablo 29 ik?ino.*ritratGS tho var.'icty of Bchool" 
wido varlablos oonsidcsrod and Wic rolntivolv low 
cmUctabiUty of any ono of them abovo. Complete 
coiTolation nuitriccs art> qivon in (6) ; it ia not 
:;oadiblo to roproduco thorn here. 

Table 29. Siniplo correlations between individual 

verbal scoro and solcGted school variable.? 
roportod by Coloman 





Mexican- 




White 


Grndc and Varinblo 


American 


Notjro 


Majori' 


Hradt'^ 12 








Toachors * SI\^ lovn** 


U » 1 


Ci 1 Q 


n At! 






U . i ^ 


0 . U U 


Teachers * location 






U « Uo 


Quality of collocje tGcichcrs 






attended 


0.20 


0.23 


0.05 


DegroG rocoived by toacher 


0.12 


0.25 


0.12 


Teachers* preferGnco .for 






middle claims student 


-0.23 


-0.15 


-0.15 


'"eachers* verbal ability score 


0.25 


0.31 


0.04 


Teachers^ race 


0.34 


0.23 


0.01 


Teachers • salary 


0.12 


0.28 


0.13 


Teachers' number of absences 


•0.10 


0 .07 


0.04 


Pupils per teacher 


-0.12 


-0.11 


-0.05 


Science lab facilities 


0.14 


0.19 


0.07 


Volumes of books per student 


0.00 


0.06 


-0.02 


Extracurricular activities 


0.17 


0.20 


0.12 


Comprehensiveness of 








curriculum 


0.09 


0 .09 


-0.03 


Student trsinsfers in and out 


-0.01 


0 .06 


0.01 


Movement between tracks 


0 .10 


-0.03 


0.03 


Days in session 


O.Cl 


0.15 


0.05 


Teacher turnover 


0.01 


0 .00 


-0.03 


Guidance coutiSelors 


0.13 


0.28 


0.15 


Attendance 


0.12 


0.05 


0.03 


college attendance of last 
year's graduates 








0 .22 


0.22 


0.20 
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Table 29. Simple correlations between individual 

verbal score and selected school variables 
reported by Coleman — Continued 

Mexican- White 
Grade and Variable American Negro Majority 



School location 
Length of academic day 
Tracking 

Accelerated curriculum 
Promotion of slow learners 
Per pupil instruction 
expenditures 

Grade 9 

Teachers' SES level 
Teachers ' experience 
Teachers ' location 
Quality of college teachers 

attended 
Degree received by teachers 
Teachers' preference for 

middle class student 
Teachers' verbal ability score 
Teachers' race 
Teachers' salary 
Teachers' number of absences 
Pupils per teacher 
Science lab facilities 
Volumes of books per student 
Extracurricular activities 
Comprehensiveness of 

curriculum 
Student transfers in and out 
Movement between tracks 
Days in session 
Teacher turnover 
Guidance counselors 
Attendance 

College attendance of last 

year ' s graduates 
School location 
Length of academic day 
Tracking 

Accelerated curriculum 



0.13 


0 .25 


0.10 


-0.01 


-0.04 


0.02 


-0.03 


-0 .02 


-0 .03 


-0.12 


-0.11 


-0.12 


0.12 


-0.02 


-0.06 


0 .09 


0.21 


0 .10 


0 .16 


0.18 


0 .05 


-0 .01 


0 .02 


-0 .06 


0.07 


0 .05 


0 .07 


0.21 


0.21 


0.02 


0 .06 


0 .20 


0 .06 


-0.21 


-0 .13 


~0 .07 


0.21 


0.23 


0 .02 


0 .36 


0 .22 


0 .06 


0 .09 


0 .24 


0 .11 


-0.06 


0.07 


0.04 


-0.06 


-0.06 


-0.06 


-0.08 


-0 .05 


-0 .04 


0.03 


0 .03 


0 .04 


0.07 


0.05 


0 .07 


0.03 


0 .05 


-0 .05 


0.05 


0.04 


0.01 


-0.00 


-0.11 


-0.01 


0.02 


0.13 


0.04 


-0.01 


0.05 


0.00 


0.07 


0.20 


0.11 


0.13 


C.07 


0.05 


0.16 


0 .20 


0.13 


0.14 


0 .19 


0.10 


0.05 


-0.02 


0.06 


-0.02 


-0.06 


-0.02 


-0.10 


-0.09 


-0.06 
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Table 29. Simple correlations between individual 

verbal score and selected school variables 
reported by Coleman — Continued 

Mexican- White 
Grade and Variable American Negro Majority 



Promotion of slow learners 


0.09 


0.08 


0.07 


rer pupil instruction 






expenditure 


0.07 


0.19 


0.11 


Grade 6 








^O'-icners SES level 


0.24 


0.15 


0.08 


ieacnerb experience 


-0.07 


-0.03 


-0.06 


Teachers * location 


0.22 


0.01 


0.08 


Quality of college teachers 








attenaed 


0.22 


0.19 


-0.00 


Degree received by teachers 


-0.03 


0.04 


0.05 


Teachers* preference for 








middle class student 


-0.15 


-0.12 


-0.08 


iGccners veroai ability score 


0 .31 


0 .24 


0.07 


ioacners rdce 


0.41 


0 .21 


0.10 


Teachers* salary 


0.16 


0 .23 


0.12 


Teachers* number of absences 


0.01 


0 .08 


0.04 


Pupils per teacLer 


-0.07 


-0.04 


0.00 


Science lab facilities 


-0.12 


-0.08 


-0.03 


Volumes of books per student 


0.11 


0.03 


0.02 


Extracurricular activities 


-0.06 


-0.08 


-0.03 


Comprehensiveness of 








curriculum 


0.03 


0 .22 


* 


Student transfers in and out 


0.10 


0.11 


0.01 


Movement between tracks 


-0.06 


-0.07 


-0.01 


Days in session 


-0.08 


0.07 


0.02 


icd^ricx uUinovSiT 


0.05 


0.06 


-0.00 


Guidance counselors 


-0.06 


0 .01 


-0.03 


Attendance 


0.28 


0.16 


0.07 


College attendance of last 








year's graduates 


0.04 


-0.01 


-0.01 


School location 


0.05 


0.18 


0.05 


Length of academic day 


-0.03 


-0.09 


-0.06 


Tracking 


-0.03 


-0.03 


-0.00 


Accelerated curriculum 


-0.09 


-0.06 


-0.04 


Promotion of slow learners 


-0.02 


-0.02 


-0.02 


Per pupil instruction 








expenditure 


0.10 


0.22 


0.10 



* 

Obvious error in printout. 
Source: Cclenan (6, Supplemental Appendix) 
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2 .4 .4 School-wide Variables and School-Average Out- 
come Measures 

In the above analysis wo have focused on the 
student as the unit of analysis and have presumed that 
the ability to explain variation in individual student 
scores comes close to NAFP's objectives for the use of 
backaround factors. While NAEP data are reported by 
subgroups of the population, these subgroups are com- 
prised of individual students. If their exercise 
scores can be adjusted for backaround individually 
it follows that adjusted subgroup P values can be 
computed • 

An important part cf the literature, however, 
has dealt with the problems of evaluation of perform- 
ance of schools, or school districts, through regres- 
sion or production function studies, or through simpler 
analytic comparative or correlation procedures. These 
studies do not appear to serve NAEP*s purposes di- 
rectly, but they do have relevance in that the school- 
wide variables ordinarily are of the same type as 
those in which there is interest in analyzing indivi- 
dual student performance, and these studies may shed 
additional liaht on the evaluation of these variables. 
Under many circumstances (but not all) it may be rea- 
sonable to assume that background or other variables 
that are more or less important in school-wide studies 
will have been ordered in about the same way, in terms 
of their relative importance in explaining variance 
of individual student outcome measures, even though 
the total amount of variance explained in individual 
outcome measures is typically considerably smaller. 

We saw earlier, in Section 2.4.3 and Tables 
19 and 20, some illustrations of the proportion of 
variance of individual student achievement scores that 
is accounted for by the variance between school means. 
It seems reasonable to assume that the information 
froir. regression or correlation studies at the school 
or school-district level does provide some rough 
boundaries or limits for interpretation of the contri- 
bution of school-wide variables to the variance of 
individual student outcome measures. (See Section 1.3 
for a discussion of the relationship between residual 
variance from school-mean-regression and individual- 
student-regression . ) 
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In any case, it has seemed de^iirable to comment 
here on some of the principal school and district 
studies, keeping in mind that here ^'^hen we speak of 
explainincT variation we are talkina about the varia- 
tion between schools (or districts) rather than the 
variation ano.g students. 

Mayeske (31, p. 9) created an individual student- 
achievem.ent composite from tests of nonverbal and 
verbal ability (all grades), plus reading comprehen- 
sion and mathematics achievement (grades 12, 9, 6, 
and 3), plus general information (grades 12 and 9). 
He constructed a Student Body Index from socio- 
economic status, family structure and racial-ethnic 
composition and a School Index which will be described 
in more detail later. His analysis of the associations 
among the individual student achievement composite 
for the school, student body, and school factors is 
shown in Table 30. 

Table 30. Summ.ary of Mayeske's analysis of the 
associations bet\/een student body and 
school characteristics and averaae 





school 


achievement — 


Coleman data 








Unique 


Components 




Grade 




Student Body 


School 


Joint 


1 


0.52 


0 .05 


0.09 


0.38 


3 


0 .56 


0.07 


0.04 


0.45 


6 


0.83 


0.10 


0 .04 


0 .69 


9 


0.87 


0.11 


0.05 


0.71 


12 


0.86 


0.08 


0 .04 


0 .74 


Source : 


Mayeske 


(31, p. 43) 







The data presented in Table 30 are interesting 
because of the relatively hiah proportion of school 
variation in achievement that can be explained by 
school and student-body characteristics — a propor- 
tion which increases dr<;matically from first to 
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twelfth arade — as well as for the evident conunon- 
ality of the effect of student body and school. Student 
body factors predicted 82 percent of the between- 
school variation of twelfth-graders and school factors 
predicted 79 percent, but their uy::ju^ contributions 
are only 5 and 9 percent, respectively. Thus, it is 
^^vident that adjustina for student-body characteris- 
tics does in fact adjust for most of the school effect 
as well. Again, one rust keep in mind that these are 
percentaaes of the between school variation and not 
percentages of the total variation am.ong students. 

Mayeske, by multiple regression analysis, iden- 
tified .31 school variables that comprise the school 
factor whose association with achievement is discussed 
above, "he 31 variables are listed in Table 31. That 
table also aives partial correlations between some of 
the 31 'ariables and school achievement with school 
size, hu.re background and race held constant (which 
accounts for the zero values shown for enrollment in 
Table 31). Apparently, pupil-teacher ratios, special- 
ized staff and services, and teacher's vocabulary 
score have consistent association with achievement 
across all arades. It is not unlikely that all three 
are correlated with the financial support provided 
by the commun i ty . 

Table 31. Partial correlations of Mayeske*s school 
variables with achievement after control 
on school size, home background and race — 
Coleman data 

Grade 



Variable 3 6 9 12 



Facilities 

1. Plant and physical 
facilities 

2. Instructional 
facilities 

3 . Age of building 

4. Pupils per room 
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Table 31. Partial correlations of Mayes>:e*s school 
variables with achievement after control 
on school size, hope background and race — 
Coleman data — Continued 

Grade 

Variable 3 6 9 12 

Pupil Programs and Policie s 

1. Tracking 

2. Testing 

3. Transfers 

4. Remedial programs 

5. Free milk and lunch 
programs 

6. Accreditation 

7. Age of texts 



8. 


Availability of texts 


0. 


04 


0.07 


0.08 


0.08 


9. 


Pupil-teacher ratio 


-0. 


08 


-0.14 


-0.30 


-0.06 


10. 


Enrollment 


0. 


00 


0.00 


0.00 


0.00 



School Personnel and Per - 
sonnel Expenditures 

1. Principal's experience 

2. Principal's training 

3 . Principal ' s college 
attended 

4. Principal's sex 

5. Principal's estimate of 

school 's reputation 0.08 0.01 0.03 0.05 
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Table 31. Partial correlations of Mayeske*s school 
variables with achievement after control 
on school size, hoine background and race 
Coleman data — Continued 

Grade 



Variable 3 6 9 12 



6 • 


Specialized stair ana 
services 


0 


.10 


0 


.10 


0 


.23 


0.18 


7. 


Teacher 's experience 
















Q 


xeacner s t. raining 
















9. 


Teacher ' s socioeconomic 
DaCKgrouncz 






-0.01 


0.04 




iu . 


1 e a en or s loca i ism 
















11. 


Teacher's college 
acuenciea 


n 




0 


.10 


0 


.05 




12. 


Teaching conditions 


0 


.14 


0 


.11 


0 


.01 


0.21 


13. 


Teaching-related 
activities 


0 


.01 


0 


.01 


0 


.01 


0.05 


14. 


Preference for student 
ability level 


0 


.04 


0 


.01 


-0 


.03 


-0.02 


15. 


Teacher's sex 
















16. 


Teacher ' s racial-ethnic 
group membership 


0 


.01 


0 


.18 


0 


.17 


-0.02 


17. 


Teacher ' s vocabulary 
score 


0 


.13 


0 


.25 


0 


.21 


0 .07 



Source: Mayeske (32, Appendix XI). 



Further analysis by Mayeske revealed the unique 
portions of explained variance associated with each of 
the three groupings of school variables listed in 
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Table 31, This analysis is equivalent to partitioning 
the unique contribution nf the "school" and "joint" 
columns of Table 30. The results are shown in Table 
32. 

Table 32. Sumirary of Mayeske*s analysis of the unique 
association between acnievement and student 
body characteristics ard groupings of 
school variables — Coleman data 

Grade 



Unique Components 3 6 9 12 



First Order 

Student body alone 

Facilities alone 

Personnel and personnel expen- 
ditures alone 

Pupil programs and policies 
alone 

Second Order 

Student body and personnel 
Others 

Third Order 

Student body, personnel and 

programs 
Student body, personnel and 

facilities 
Others (including fourth order) 

r2 



* Less than 0,005, 

Source: Mayeske (31, p. 51) 

It may be seen that the interaction of average 
student-body characteristics and school personnel 
dominates the explanation of between-school variance. 
Facilities do not enter with any significance except 
for twelfth grade, and then only in interaction with 
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0.07 0,10 0,11 0,08 

* * * * 

0.03 0,03 0,02 0,02 

* 0,01 0,01 0,02 



0.35 0.55 0.49 0.45 
0.01 0.01 0.02 0.01 



0.08 0.12 0.12 0.07 

* 0.02 0.03 0.17 
0.02 * 0.07 0.05 

0.56 0.83 0.87 0.86 
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student body and personnel. Pupil programs and 
policies alone contribute a very small amount and 
join with student body and school personnel factors 
in contributing a nontrivial amount to th3 explanation 
of variance. 

The California State Testing Program of 1970-71 
(4) provides a good example of predictability of 
background factors at the district level. Twenty-two 
background variables were examined within elementary, 
unified, and high school districts with respect to 
their ability to predict reading scores for grades 1, 
2, and 3 and reading, language, spelling and mathema- 
tics scores for grades 6 and 12. A stepwise regres- 
sion program was used and the order of entry of the 
predictor variables is presented in Tables 33 through 
35 for the three kinds of districts studied. 

It is interesting to note that the first and 
second variables to enter the prediction equation in 
almost every case are variables which reflect poverty 
and minority enrollments. At the bottom of the tables 
are shown the proportions of variance in average 
district scores accounted for by all of the variables 
in the table, by the first one to enter the equation, 
and by the first two. It is apparent from these data 
that a major portion of the explained variance is 
accounted for by the index of family poverty and by 
minority enrollments. 

One unusual feature of the California study is 
that the percent of variance explained by linear re- 
gression was cross-validated on random ha.Wes of the 
sample. The results of the cross-validation for 
unified school districts is shown in Table 36. These 
cross-validation results are not as favorable as for 
elementary districts but more favorable than for high 
school districts. They provide a means for judging 
repeatability of the results on an independent study. 
The sample sizes here, in terms of numbers of districts, 
are relatively small, and consequently overestimates 
of explained variance from a sing?e sample will be 
considerably greater than would occur for much larger 
samples , 

Extensive tables of regression and correlation 
results are presented in convenient reference form in 
the study. 
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Table 36. Results of cross-vwilidation study, unified 
districts 

Proportion of Variance 



Accounte-'i for (R ) 









(A) 2 


(B) 2 










Ave race R 


Average R 


Differ- 




Dependent 


Total 










Variable 


Sample 


Subsamples 


Validation 


'A-B) 


1 


Read! na 


0 . 3262 


yj • o 4C w 


U • 6 U 37 3 


A 1 0 Q 


2 


Reading 


0 .4615 


0 .4797 


0 .4199 


0 059fi 

\J « V/ «J 7 o 


3 


Reading 


0.5609 


0.6000 


0.4754 


0.1246 


6 


Reading 


0.5559 


0.6051 


0.4397 


0.1654 


6 


Language 


0.5895 


0.6015 


0 .5254 


0.0761 


6 


Spellinc, 


0.4947 


0.5358 


0.3363 


0.1995 


6 


Mathematics 


0.5636 


0.5880 


0 .44eiL7 


0.,1413 


12 


Reading 


0.4462 


0.4832 


0 .3] S3 


0.1679 


12 


Language 


0.4505 


0.4616 


0 .3512 


0.1104 


12 


Spelling 


0 .366.1 


0.3837 


0.3101 


0.0736 


12 


Mathematics 


0.4965 


0.4932 


0.4481 


0.0451 



Source: (4) 



Garms (18) studied the relationship between 
socioeconomic characteristics and pupil achievement in 
elementary schools in New York State. The school was 
the unit of analysis and he examined 303 SES variables. 
School? were stratified into five strata: New York 
:ity, other urban, New York SMSA^ upstate SMSA and 
non-SMSA. About 20 third-grade pupils were sampled in 
each school. Two basic outcome measures were obtained 
on the sample Oj. students in each school: 

0 Average score on the Reading Test of the New 
York State Pupil Evaluation Program 

• Average score on the Arithmetic Test of the 
New York State Pupil Evaluation Program 

The principal outcome variables used in the analysis 
were percent scoring below the fourth stanine in each 
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of tho above tests and in the combined test. The 15 
background variables most highly correlated with the 
above criterion variables are shown in Table 37, 

Table 37, Simple correlations of Arithmetic and 

Reading test criteria with 15 most highly 
correlated background variables New 
York State data 



Simple Correlations with 
Percent Below 4th Stanine 



Reading 
and 

Background Variables Arithmetic Reading Arithmetic 



1, Average years of ed- 
ucation of mothers 

2, Percent of children 
eligible for free- 
lunch program 

3, Average years of ed- 
ucation of fathers 

4, Percent of fathers 
with 10 or fewer 
years of education 

5, Percent of children 
from broken homes 

6 • Percent of heads of 
households whose in- 
come is less than 
$5 , 000 per year 

7 , Percent whose occu- 
pation is other 
than professional, 
skilled, service 
worker, or farm 
worker 



-0,677 -0,630 -0.658 

0,676 0.610 0,677 

-0.671 -0,627 -0,649 

0.660 0*616 0,639 

0,660 0.613 0.643 

0,632 0,580 0,621 

0.613 0,570 0,596 
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Table 37. Simple corrolations of Arithmetic and 

Reading test criteria with 15 most highly 
correlated background variables New 
York State data — Continued 

Simple Correlations with 
Percent Below 4th Stanine 



Reading 
and 

Background Variables Arithmetic Reading Arithmetic 



8. 


Percent living in 
home owned bv 
parents 


-0.613 


-0.575 


-0.591 


9. 


Percent living in an 
apartment 


0.590 


0.538 


0.585 


10. 


Percent of fathers 
witn / or fewer 
years of education 


0,590 


0.551 


0.570 


11. 


Percent of over- 
crowded housing 


0.577 


0 .534 


0.563 


12. 


Percent Puerto Rican 


0.551 


0 .524 


0.523 


13. 


Percent of low-rent 
apartments 


0.549 


0.508 


0.537 


14. 


Percent Negro 


0 .543 


0.515 


0.518 


15. 


Percent whose 
father's occupation 
is professional 


-0.529 


-0.506 


-0.499 



Source: Garms (18) 



The data are remarkable for their consistency 
across the two criterion measures and for their simi- 
larity among the 15 background factors. Also, it may 
be important to note that the measures {or a close 
approximation for them) may b^ obtained for the school 
attendance area from Census data* 



113 



ERiC 



Garms found that in using 30 SKS variables he 
could account for 6 5 percent of the variation among 
schools in the percent of students below the fourth 
stanine in reading and arithmetic. With only three 
of the SKS variables (percent in broken homes, percent 
in overcrowded housina and years of occupation of 
mother) , including interactions among them, he was 
able to account for 62 percent of the variation. 
Thus the other variables accounted for only an addi- 
tional three percent. The study verified results of 
an earlier New York study by Garms et. al. 

The Fleischmann Report (15), which relied on 
sore of the analytical work of Garms, found essenti- 
ally the same results for third, sixth, and ninth 
grades. Some key results are shown in Table 38. 
They relate the distribution of the Reaents Scholar- 
ship and College Qualification Test (RSCQT) to five 
SES categories based upon Garms' variables. 

Table 38. Distribution of RSCOT scores by SES 
classes Fleischmann data 



RSCQT 


Scores 


SES I 


SES II 


SES III 


SES IV 


SES ' 


Upper 


quarter 


50% 


37% 


31% 


21% 


13% 


Upper 


half 


26% 


30% 


27% 


23% 


18% 


Lower 


half 


17% 


22% 


25% 


26% 


27% 


Lower 


quarter 


7% 


12% 


17% 


30% 


42% 



Source; Fleischmann Report (15) 



A number of state studies sho^\' results that are 
not inconsistent with the above. Amona tiie studies 
reviewed in the preparation of this report that show 
regression and multiple correlation measures are the 
following : 

A Regression or Multiple-Correlation Study 

H. J. Kiesling, "The Relationship of School Inputs 
to Public School Performance in New York State," 
p-4211, The Rand Corporation, October 1969 (29) 
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other Analytlcal-Typo Studies 



Donovan, DcU^id and others, "Distribution of Educa- 
tional PerformwHnce and Related Factors in 
Michicran." The Sixth Report of the 1970-71 
Michiqan Educational Assessment Proqram, Michigan 
State Department of Education, Research, Evalua- 
tion and Assessment Services, Lansinq, Michiqan, 
June 1972 (10) 

"1971 Texas Achievement Appraisal Study," Texas 
Education Agency, Austin, Texas, May 1972 (46) 

"Sixth Grade Reading: A Needs Assessm.ent Report," 
Texas Education Agency, Austin Texas, 1972 (47) 

Firman, William D., University of the State of New 
York, The State Education Department, "The 
Quality Measurement Project in New York State," 
presented at American Association for the 
Advancement of Science, Berkeley, California, 
December 29, 1965 (12) 

Also, "Performance Indicators in Educat ion-PIE, " 
The University of the State of New York, The State 
Education Department, (51) includes a general descrip- 
tion of issues in such studies, and a survey of 80 
studies • 

We believe that the studies we have chosen to 
cite capture the principal conclusions chat can be 
gleaned from such reports, although others could have 
been chosen to portray similar results. 



2.5 Other Background Factors, Including Attitudes, 
Motivations, Self-Perception, Aspirations, In- 
tentions, and Expectations 

There remains one last group of factors that has 
been found to influence students' achievement, after 
taking account of SES, individual ability, and the 
characteristics of schools. It is the attitudinal- 
motivational state of the student, broadly defined. 
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In the introduction, we stated our intention to 
restrict our discussion to summary results of studies 
of intermediate variables. The summary treatment is 
based upon two considerations: 

1. The students* affective states are not background 
factors in the same sense as those presented 
earlier in this chapter — they are intermediate 
factors in that they are influenced by earlier 
educational histories {among other influences) , 
and that they affect later educational performance* 
indeed, they might sometimes become the mechanism 
by which various factors have influence upon 
achievement; for example, school policies might 

be designed to improve the self-imaae of a dis- 
advantaged group, leading in turn to improved 
student performance, 

2. These affective states are subject to change, 
especially over a period of time, unlike the 
principal family characteristics and the demo- 
graphic characteristics of the student. 

In this chapter we consider affective states as 
background variables, even thouqh they may be influ- 
enced by the educational process. In Chapter 3 we 
consider them as outcomes and study their association 
with more traditional kinds of background. This 
varied treatm.ent is a reflection of the fact that 
attitudes, motivations , self -percept ions , expectations, 
and so on, are in fact trterrediate variables rather 
than background or outcome variables. 



2.5.1 Student-Parent Relationships 

A number of studies have considered the rela- 
tionship between parents and students as a background 
variable. Such relationships are usually expressed 
in terns of the student's perception of the interest 
his parents have in his school achievement, in their 
desire for a high level of educational attainment, 
their interest in the student's nonschool problems, 
and the assistance they give him with his homework. 
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Coleman (5) inquired concernings 

Whether anyone read to the student before he started 
to school 

Kow good a student the mother (father) wants him to 
be 

How often studentb talk with parents about homework 
Father's (mother's) desire for child's educational 
level 

Frequency of parents' PTA attendance 

Mayeske {32, pp, 373-4) tabulated the composite out- 
come measure by responses to these questions and the 
results for grade 3, 6 and 12 are shown in Table 39. 

Table 39, Scale values assigned by Mayeske to various 
measures of parental interest in child — 
Coleman data 



Grade 



Item 


3 


6 


12 


Whether anyone read to preschool child 








No 


* 


44.4 


46.7 


Once in a while 


* 


50.1 


48.8 


Many times, but not regularly 


* 


53.6 


51.5 


Many times and regularly 


* 


51.7 


51.4 


Don't rememJoer 


* 


47.9 


48.3 


Non response 


* 


40.0 


43.9 


Percent of variance explained 




8.3 




Mother's desire for child's excellence 








One of the best students in class 


50.5 


51.0 


51.7 


Above the middle of the class 


50.8 


51.2 


50.8 


In the middle of the class 


46 .8 


47.5 


44.8 


Just good enough to get by 


48.3 


44.2 


41.2 


Don ' t know 


47.4 


47.8 


^6.4 


Nonresponse 


43.5 


40.5 


46.7 


Percent of variance explained 


2.0 


5.8 


7.1 


Father's desire for child's excellence 








One of the best students in class 


50.7 


51.1 


51.7 


Above the middle of the class 


50.2 


51.0 


51.0 


In the middle of the class 


46 .5 


47.0 


45.1 
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Table 39, Scale values assigned by Mayeske to various 
measures of parental interest in child — . 
Coleman data — Continued 

Grade 



Item 3 6 12 



Just good enough to get by 

Don't know 

Nonresponse 

Percent of variance explained 

School discussion with parents 

Just about every day 
Once or twice a week 
Occasionally, but not often 
Never, or hardly ever 
Nonresponse 

Percent of variance explained 

Father's desire for child's educational 
level 



48.1 44.3 42.8 

48.6 48.2 46.8 

44.4 41.6 46.3 

2.2 5.6 6.7 



51.1 50.5 
49.7 50.3 

51.5 49.0 

46.6 49.0 

42.2 45.0 
5.9 0.7 



Doesn't care if child finishes high 
school 

Finish high school only 

Technical, nursiii , or business school 

after high school 
Some college, but less than four years 
Graduate from a four-year college 
Professional or graduate school 
Father not at home 
Don't know 
Nonresponse 

Percent of variance explained 

Mother's desire for child's educational 
level 

Doesn't care if child finishes high 
school 

Finish high school only 

Technical, nursing, or business school 

after high school 
Some college, but less than four years 



45.4 
45.1 

47.3 
47.2 
53.1 
55.7 
47.4 
47.7 
45.2 
12.6 



44,7 
45.0 

47.1 
47.1 
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Table 39, Scale values assigned by Mayeske to various 
measures of parental interest in child — 
Coleman data Continued 

Grade 



Item 3 6 12 



Graduate from a four-year college 
Professional or graduate school"' 
Mother is not at home 
Don't know 
Nonresponse 

Percent of variance explained 

Frequency of parents' ptA attendance 

Not at all 

Once in a while 

About half the meetings 

Most or all of the meetings 

There isn't a parent association 

Don't know 

Nonresponse 



Coding of answers not clear. 
Source; Mayeske (32, Appendix III) 



Apparently, reading to the preschool child is 
associated with higher scores. Unfortunately, it is 
not possible to determine from the Mayeske data the 
correlation between this factor and, say, parental 
education • 

Although there is an apparent association be- 
tween parental desire for child's excellence and 
achievenent, as well as between parental desire for 
the child to achieve a high educational attainment 
and achievement, one cannot help but wonder if these 
measures of parental attitude are influenced by 
performance. It would be surprising if they were 
entirely independent. In any case, both measures seem 
to be such that dichotomous response categories would 
suffice, i.e., parental desire for "above average" 
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52.8 
55.0 
47.8 
47,8 
44.5 
11.7 



49.8 
50.0 
49.7 
51,3 
53.6 
47.5 
44.3 
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perfcrmancG and for attainment of a four-year college 
degree. These are the points in the response cate- 
gories whare major changes in the criterion occur* . 

No ren^arkable differences appear in the associa- 
tion between outcome and the measure of parental 
attendance at PTA meetings except for the distinctly 
higlier average for children who reported no PTA in 
the school. One can hardly believe that this is ^ 
causative relationship. It may be that schools with 
no PTA have a more highly selective student body. 

The student questionnaire for the international 
study cf literature education {Purves, 41) asked sev- 
eral questions concerning student-parent interaction* 

10. How often does your mother or father 
help you with your homework? (three 
categories) 

11. When you talk at home, do your parents 

always or almost always insist that 

you speak correctly? 
sometimes insist that you speak 

correctly? 
let you speak how you please? 

12. When you show your parents anything you have 
written, do they 

always or almost always check your 

spelling? 
sometimes 'check your spelling? 
rarely or never check your spelling? 

14. In your spare time at home, do your parents 

encourage you to read as much as possible? 
sometimes suggest you read? 
not mind if you never read? 

15. When you get home from school, do your 
parents 

always or almost always want to know how 

you have done? 
sometimes ask about your school work 
hardly ever or never ask you about your 

homework? 
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other questions concerned number of hours of TV- 
watching, hours spent reading^ and so on, 

Purves reported the multiple correlation coef- 
ficient (for the United States) of 0,39 between lit- 
erature scores and the parental-interest variables, 
and showed that there was only a 0.002 increment in 
beyond the contributions of other variables (41, 
p- 417). 

Thorndike (48, Table 6,1) used the same data as 
Purves, but with reading comprehension scores as the 
criterion. He created a "parental interest" composite 
fron (1) parent's interest in school, (2) encourage- 
ment given the child to read, and (3) encouragement 
given the child to visit museums. He created a "par- 
ental help" composite from (1) whether they typically 
corrected his speaking, and (3) whether they typically 
corrected his writing. He found the following simple 
correlation coefficients for U.S. students: 



Parental Parental 
Interest Help 

Population I (10-year-olds) 0,08 -0,07 

Population II (14-year-olds) 0,11 -0,20 

Population IV (seniors) 0,16 -0,15 

He reported (pp. 75-6), "In every country, it was 
found that the children who reported that their parents 
helped them with their homework tended to get poorer 
reading scores than those who reported that their 
parents seldom or never provided this type of help," 

Bachman in Youth in Transition (1, Vol. II, 
pp. 17-21) studied interpersonal relationships of 
tenth-grade boys with their parents. Five indexes 
were constructed: 



• Parental control 



• Closeness to mother 



• Closeness to father 



• Parental consultation with son 



• Parental punitiveness 
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The first did not show any relationship with the cri- 
terion variables, but the other four did* Since the 
treatr.ont of such variables is more extensive than 
in most of the reports reviewed, Bachman's questions 
and scale values are reported, for reference, in 
Table 40, He described construction of the scales as 
follows : 

A total of 21 questionnaire items were used 

to compute the measure of family relations. The 
total score on this scale consists of the mean of 
the scores for all available items, with up to five 
missing data cases allowed; in other words, a re- 
spondent had to provide answers to at least 16 of 
the 21 questions in order for a scale score to be 
computed. The scores for each response are indicated 
in parentheses; score values {ranging from 1 to 5) 
were assigned in such a way as to reduce distortion 
caused by missing data. 

Bachman reported a small positive correlation 
between the family-relations index and socioeconomic 
level, small negative correlation with number of 
siblings, and positive correlation with intact homes. 
An indication of the amount of association with the 
Quick Test as a criterion variable is provided by 
Table 41. For this purpose Bachman 's E^a of 0.16 may 
be interpreted as a simple correlation coefficient of 
that magnitude. Hence it is clear that the variable 
has small explanatory power alone and would have even 
less after account is taken of socioeconomic level, 
number of siblings, broken homes and possibly other 
variables . 

Peaker, in a rearession analysis of the Plowden 
data (8, Appendix 4) reported three parent-student 
variables : 

• Aspiration for the child 

• Literacy of home 

• Parental interest in school work and progress 

The variables are composites and the criterion vari- 
able is score in a test of reading comprehension. 
Analyses were done for three acre groups, both between 
schools and among students v;3thin schools. Results of 



Table 40* A composite measure of family relations — 
Bachman 



Cl.OSKNI-SS TO FATHER 

When you wore growing up, how did you fool about how 
much affection you got from your father (or male 
i^uurdian ); 

Van tod and got enough affection 
Wanted sliyht ly more than I received 
Wanted more tl'.an I receivod 
Did not want affection from him 

How often do you and your father (or male guardian) 
do things together chat you both enjoy-tliings like 
playing sports, or going to sporting events, or working 
or. things together.' 

Several times a week 
About once a week 
Once or twice a month 
Less than once a month 

How close do you feel to your father (or male guardian)? 

Kxtremely close 
Quite close 
Fairly close 
Not very close 

much do you want to be like your father (or male 
guardian) when you're an adult? 

Very niiich like him 
Somewhat like him 
A little like him 
Sot very much like him 
Not at all like him 



?o Answering, and 
Score Value (in 
parentheses 



60 
18 
14 
5 



19 
29 
21 
22 



30 
35 
19 
8 



26 
36 
18 
8 
6 



(4) 
(3) 
(2) 
(I) 



(5) 
(4) 
(3) 
(2) 



(5) 
(4) 
(3) 
(2) 



(5) 
(4) 
(3) 
(2) 
(1) 



Percvnra.cfs do not add to 100 because missing data are not listed in this 
cable. Missing data never exceedt^d 87,, and usually equalled 2^, or 3%, 
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Table 40. A composite measure of family relations 
Bachman — Continued 



(:LO:iXNi:SS TO MOTMKR 

When vou wore growing up, how did you foe I about 
.*iOw much affection you got from your motlier (or 
femalo f;uardia:i)/ 

Wan tod and ^ot enough affection 
Wanted sll>^l.tly more than 1 received 
Wantt'd moro than I received 
Did not want affecLion from her 

how close do you feel to your motlier (or female 
^'uardlan ' ' 

Kxtrenjoly close 
Quite close 
Fairly close 
Not very close 

How mucii do you want to be like the kind of person 
your mother (or female guardian) is? 

Very much 
Somewhat 
A little 
Not very much 
Not at all 



li Answering, and 
Score Value (In 
parenjiheses ) 



72 
15 
7 
3 



42 
37 
15 
3 



20 
38 
25 
9 

k 



(4) 
(3) 
(2) 
(I) 



(5) 
(4) 
(3) 
(2) 



(5) 
(4) 
(3) 
(2) 
(1) 



AMOL'NT OF RF.ASON ING W ITH SON 

how mui-'h influence do you feel you have in family decisions 
that affect vou? 



A great deal of influence 
Considerable influence 
Moderate influence 
Some influence 
Little or no Influence 



19 
33 
26 
13 
6 



(5) 
(4) 
(3) 
(2) 
(I) 



Next Wf would like to get some Idt-a of how 
oftT.'n your parents (or guardians) do each 
of tho following things: 



I.istei; to your side of the a^gun.ent. 
Talk ovfr important decisions with ynu. 



Act fair and rea>onahle in what they ask of you. .19 







ot 






I ways 




a# 
E 






c 




•i 


^ver 


< 


o 




VI 




.18 


30 


32 


13 


5 


(5) 


(4) 


(3) 


(2) 


(1) 




32 


34 


14 


5 


(3) 


(4) 


(3} 


(2) 


(1) 


.19 


36 


33 


9 


2 


(5) 


(4) 


(3) 


(2) 


(I) 
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Table 40 • A composite measure of family relations 
Bachman — Continued 

AMrfworlni;» and 
l>a routhosos ) 

PA.UNTAI. PIMHVKNKSS 



Nl' X C Wo would 1 1 k e 1 0 t s one I d u a o i* 






'/, 






row i^t'Cc^n your pari-ius (or Muardians) 


'A 




& 


g 




do faci". ot tho tollowlnf^ things: 










If 
















< 


o 








Comp I e t e I y i j'no you a t* to v you ' Vf done some • 














3 


9 


19 


33 


31 




(I) 


(2) 


(3) 


(4) 


vi) 


\vt as ii dov don't care ahout vovi a;U' more . 


3 


6 


l'> 


26 


48 




(I ) 


(2) 


(3) 


(4) 


(5) 


uisa>.',rce with oacn other when it co;'.a*s u> 














4 


10 


22 


32 


29 




(I) 


(2) 


(3) 


(A) 


(5) 




2 


7 


19 


31 


39 




(I) 


(2) 


(3) 


(A) 


(5) 


Take away your privileges (IV, movios, dates). 


3 


9 


25 


35 


26 




(I) 


(2) 


(3) 


(4) 


(3). 


Blaino you or criticljjo you when you don't 














3 


13 


32 


36 


15. 




(1) 


(2) 


(3) 


(A) 


(5) 




5 


13 


27 


29 


24 




(1) 


(2) 


(3) 


(A) 


(5; 




6 


16 


34 


30 


11 




(I) 


(2) 


(3) 


(A) 


(5) 




3 


11 


31 


34 


19 




(1) 


(2) 


(3) 


(A) 


(5) 




6 


16 


31 


29 


16 




(I) 


(2) 


(3) 




(5) 
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Table 41. Mean Quick Test scores for each category 
of family relations 



Grand Mean = 108.5 
Grand Standard Deviation = 12.5 



Predictor 
Category 



Weiahted N Percent 



Unadjusted Standard 
Mean Deviation 



2 
3 
4 
5 
6 
7 



1 (poor) 



8 (good) 

9 Missing Data 



106 
199 
344 
482 
555 
427 
259 
90 
52 



4.2 
7.9 
13.7 
19.2 
22.1 
17.0 
10.3 
3.6 
2.1 



108.78 
106.30 
105.69 
107.88 
108.83 
110.93 
110.92 
109.60 
102.32 



13.03 
14.61 
12.65 
12.21 
13.25 
11.31 
10.87 
9.03 
9.67 



Eta = 0.16 



Source: Bachman (1 Vol. II, Table E-4-4) 



the within-schools analysis are reported in Table 42. 
The percent of explained variance includes literacy^ 
which is perhaps approximately equivalent to education 
of parents in U.S. studies. Also, the analysis is a 
within-schools analysis while the other studies re- 
ported above are across all schools. Even with some 
downward adjustment for these factors the explained 
variance seems high in comparison with U.S. results. 

On the basis of the results cited in this section 
it appears that relationships between parent and child 
do have an impact on school outcomes. However, sub- 
stantially differing results have been obtained by 
different investigators. How much of these differences 
is due to the outcome measures, how much to the partic- 
ular measures of parent-student relationships, and how 
much to the peculiar characteristics of the population 
being studied is unknown. Some additional perspective 
will be provided in the next section where joint 
relationships are examined in more detail . 
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Table 42, Variance in reading comprehension scores 
accounted for by parental variables 
Plowden data 



Simple Percent of 

Group and Variable Correlation Variance 

Top Junior Boys 

Aspirations for child 0.41 

Literacy of home 0,36 

Parental interest 0.42 26 

Top Junior Girls 

Aspirations for child 0.57 

Literacy of home 0,37 

Parental interest 0.43 36 

Lower Junior Boys 

Aspirations for child 0.27 

Literacy of home 0.34 

1-arental interest 0.22 15 

Lower Junior Girls 

Aspirations for child 0.25 

Literacy of home 0.26 

Parental interest 0.24 12 



Source: Peaker (9, Tables 5.1 - 5.4} 



2.5.2 Attitudes, Expectations and Kindred Variables 

Bachm.an (1) used the Quick Test of Intelligence 
as the indicator of ability for most of his analyses 
and his study population was tenth-grade boys. However/ 
we haye used it as an indicator of achievement ear- 
lier in this chapter and continue to do so here. 

Bachman reported correlations between the Quick 
Test and various affective measures as shown in Table 
43. 
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Table 43, Correlations between various affective 

states and Quick Test scores reported by 
Bachmn 



variable Correlated 
With Quick Test 



Correlation Percent 
Coefficient Explained 



Self-concept of school ability 
Positive school attitudes 
Negative school attitudes 
N'eed for social approval 
Sel f-esteem 
Social values 
Ambitious job attitudes 
Total internal control 
College plans 
Occupational aspirations 



0.43 
0.07 
0.25 
0.15 
0.14 
0.19 
0.28 
0.22 
0.30 
0.38 



0.18 
0.01 
0.06 
0.02 
0.02 
0.04 
0.08 
0.05 
0.09 
0.14 



In Chapter 3 we discuss Bachman's findings with respect 
to the ability to predict these affective measures 
from other background factors. 

Table 43 shows that self-concept of school abil- 
ity explains 21 percent of the variation in Quick Test 
scores. One must presume, of course, that self-concept 
is nontrivially correlated with real ability. The 
next highest correlation is with occupational aspira- 
tions, which explains 14 percent of variation. 

Three variables not shown in Table 43, because 
they are not affective states, motivations or aspira- 
tions, are religious preference, family political 
preference and political knowledge with correlation 
ratios with the Quick Test of 0.26, 0.13 and 0.36, 
respectively. They are reported here because they 
do not fit any other section of this chapter. 

Mayeske (31) constructed an index called Family 
Process that included expectations for excellence, 
attitude toward life, educational plans and desires, 
and study habits. He was able to show that there was 
some correlation between achievement (as measured 
by his achievement composite) and these indices of 
student attitude. His results for third, sixth, ninth, 
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and twelfth grades are shown in Table 44, The tend- 
ency for these measures to reach their maximum assoc- 
iation with achitsvement in the ninth grade is worth 
noting . 

Table 44, Simple correlations found by Mayeske be- 
tween attitude indices and achievement — 
Coleman data 



Grade 



Attitude Index 


3 




6 


9 


12 


Expectations 


0.17 


0 


.26 


0.39 


0.35 


Attitude toward life 


0.13 


0 


.38 


0 .47 


0.42 


Educational plans and desires 


0.24 


0 


.48 


0.51 


0.49 


Study habits 


0 .34 


0 


.37 


0.36 


0.23 



Mayeske also showed that these attitude indexes 
were nontrivially correlated with his index of SES, 
the percent of explained variance in SES ranging for 
ninth grade from a low of 0.15 for Attitude Toward 
Life to a high of 0,29 for Educational Desires and 
Plans, 

The international assessment studies have in- 
cluded a group of variables identified as "kindred 
attitudes and interests." For the literature evalua- 
tion (Purves, 41) this group of variables included: 

o Age of students 

o Expected occupation and education of the 
students 

o Predominant sex of the students 

o Amount of homework per week 

o Amount of reading for pleasure 

o Reading and viewing interests 

o Literary- interest score 

o Reading mystery and detective stories 
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Age and sex of students have been discussed elsewhere 
by us, and some of the items are specific to the 
literature test. Purves shows that these kindred 
variables (except for sex and age) account for six 
percent of the variation in senior student achievement 
in literature in the United States beyond the 24.9 
percent accounted for by home background, age, sex, 
type of school, and instructional variables. They 
also account for 9.2 percent of the variance in 14- 
year-old scores beyond the 28.6 percent accounted for 
by the same other background variables. Thus, one 
must attribute nontrivial importance to these attitu- 
dinal variables in the prediction of literature scores* 

Comber and Keeves (7) included in kindred vari*- 
ables science interests and attitudes and science 
reading in addition to expected education, expected 
occupation and hours reading for pleasure. They 
found that for high scho 1 seniors in the United 
States these kindred variables added four percent in 
explanatory power to the 35 percent accounted for by 
home background/school factors and learning conditions. 
Again, this is a nontrivial addition. If these kindred 
variables had been entered first in the regression 
equation they would have contributed substantially 
m.ore than four percent. For example, the following 
simple correlation coefficients between the measures 
shown and science scores were reported by Comber and 
Keeves for twelfth-grade students in the United States: 

Science attitudes 0.43 

Expected education 0.32 

Expected occupation 0.14 

Hours reading for pleasure 0.18 

The first, alone, would have accounted for over 18 
percent. Of course, it is also correlated with a 
number of other background factors. 

More will be said concerning intermediate-type 
variables in Chapter 3 where their analysis is con- 
sidered both as an outcome and as an input to other 
outcomes. Here it is sufficient to note that their 
association with academic performance is nontrivial. 
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2.6 Surunary 

We close this chapter by presenting some results 
which show the proportion of variance in academic 
outcomes that can be accounted for by all background 
factors. Conber and Keeves (7) present the results 
shewn in Table 45, where the outcome is total science 
test scores. The total percents accounted for range 
from 34 to 39 percent. 

Table 45. Incremental percents of variance in indi- 
vidual student science test scores 
accounted for by all background variables 
studied, U.S. — Comber and Keeves data 

Variable or 



Composite 


10-year-olds 


14-year-olds 


Seniors 


Hor.e circumstances 


16 


16 


9 


Age of student 




1 


1 


Sex of student 


1 


4 


8 


Type of program 




2 . 


9 


Type of school 


1 






Learning conditions 


9 


7 


8 


Kindred variables 


7 


6 


4 


Total 


34 


36 


39 



Source: Comber and Keeves {7, Chapter 9) 

Purves (41) made similar estimates for literature 
scores. They are summarized in Table 46. Note that 
these percentages (61.5 and 53.0) are higher than the 
34 to 39 percent in science, above. However, two 
other outcor.e variables, word knowledge and reading 
comprehension, have been included, and it seems rea- 
sonable to assume that they are relatively highly 
correlated with literature scores. Excluding them, 
the percents accounted for are 37 and 31 for 14-year- 
olds and hiah-school seniors, respectively, figures 
that are reasonably comparable with the Comber and 
Ke^eves f indinas . 
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Table 46. Incremental percents of variance in 

individual student literature test scores 
by all backaround variables studied, 
U.S. Purves data 







Hign Scxiooi 


Variable or Composite 


14-year-olds 


Seniors 


Kore background and reading 






resources , age , and sex 


18e5 


16.5* 


Type of school/type of 




3.4 


program 


2.4 


Instructional variables 


7.7 


5.0** 


Kindred attitudes, inter- 






ests, and other student 






attributes 


9.2 


6.0 


Word knowledge 


10.0 


8.5 


Reading comprehension 


13.7 


13.8 


Total 


61.5 


53.0 



Includes nuinber of siblings. 

if if 

Includes teacher and school characteristics. 



Source: Purves (41, Chapter 6) 



Bachman (1, Vol II, p. 72) reported 35 percent 
of variance in Quick Test scores accounted for by: 

• Socioeconomic level 

• Number of siblings 

• Broken home 

• Family relations 

• Religious preference 

• Family political preference 

• Coirjnunity size 

• Race 
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Usirg only race, SFL, and number of siblings as pre- 
dictors, he was able to account for 33 percent, 

Mayeske, using the Coleman aata (33, Chapter 6) 
found that he could account for about 53 percent of 
the variation in individual student achievement by 
family background and school measures. Attitudes, 
motivations and abilities would account for an addi- 
tional increment, althoucrh we do not find the data 
sun\mari2ed in that manner, 

What emerges from this chapter, then, is that 
one might expect to account for from one-third to one- 
half of the variation in individual student measures 
of academic achievement by background factors that 
include measures of SES, family composition, student- 
parent relationships, race, sex, urbanism, ^.-eographic 
location and school and teacher variables, However, 
there are important differences in predictability by 
age groups, by racial-ethnic groups, and by outcome 
measures. 
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CHAPTER 3 



OUTCOMES OTHER THAN ACADEMIC ACHIFVEMENT 



3.1 Overview and Summary 

The background and other factors that influence 
educational achievement are reviewed in Chapter 2, 
above, along with notes on measurement problems, 
methods of analysis, and the kinds of considerations 
required for a valid interpretation of the data. 
The present chapter explores the evidence on the kinds 
of factors that influence further education, occupa- 
tion, income, job histories, and some other outcomes 
of the educational process, 

Mushkin et al . (39) have idenwified a number 
of measures of educational outcome that are related 
to personal and societal objectives as follows: 



Investment yield 



Consumer effectiveness 



(1) Advances in earnings 
with added schooling 

(2) Employment indexes 
(including unemploy- 
ment rates by educa- 
tional level) 

(3) Moti^/ational behav- 
ior toward learning 
of children 

(4) Patterns of consump- 
tion 



(5) Relative use of pre- 
ventive medical and 
dental services 

(6) Reading expenditure 
patterns 

(7) Recreational program 
uses 
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Political effectiveness 



(8) Voter participation 
and behavior 



(9) Group-interest par- 
ticipation (school 
board elections, 
coiranunity neighbor- 
hood groups) 

(10) Community services 
performance 

(11) Holding of public 
office 

Personal effectiveness (12) Capacity to reach out 

for satisfactory 
quality of life 

(13) Self-esteem 

(14) inuernal-external 
control 

(15) Other attributes 

Intellectual effectiveness (16) Capacity for creativ- 
ity 

(17) Knowledge about 
selected items 

(18) Completion of high 
school 

(19) Attendance at college 
or other post- 
secondary schools 

The examined literature does not provide the basis for 
measuring associations between background and all of 
the above measures. However, Mushkin*s list provides 
a valuable classification of outcomes for many 
purposes. It may be observed that most National 
Assessment exercises are measures of item (17) above, 
but some also fall under the heading of "political 
effectiveness" and "personal effectiveness." In this 
chapter most of the outcome measures are identified 
with items (1), (2), (13), (18) and (19). 
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In this study it will be seen that the various 
background factors have different patterns of influence 
on tho educational outcomes reviewed in this chapter, 
compared with the outcomes reviewed in Chapter 2. 
But — and this is an important findina in the present 
context — the most influential factors a^e the same 
ones for both classes of outcones. This r^^^sult is a 
fortunate one from the viewpoint of research design. 
It directs attention and resources to relatively few 
factors — and hence relatively few survey items 
which can be measured and used instead of attempting 
a broader and more superficial cc^verage, with in- 
creased costs, more serious response burdens, and 
attendant operational problems. Zven the relatively 
complex sex-race interaction for early job exi^ariences 
depends upon the sam.e survey items found to be essen- 
tial to the analysis of achievement scores. 

Many different aspects of adult Life can be 
regarded as educational outcomes in the sense that 
experiences connected with the processes of formal 
education can be influential. Some of these are 
expressive of intellectual development, such as 
eventual educational attainment, reading habits, 
choice of occupation, etc. Others are strongly 
economic: labor-force participation, employment 
history, periods of unemployment, income, welfare 
experiences, expenditure patterns. Others express 
societal roles: voting behavior (whether a person 
votes, rather tjan for whom), participation in 
ccpmjT^unity-betterment activities or volunteer work 
with those less fortunate. Important aspects of adult 
life also include familial roles and aesthetic life 
such as work in the graphic or performing arts or in 
creative writing. 

All of the above kinds of characteristics of 
adult life fall within one or more of the 10 classes 
of r;AEP objectives, presumably to be embodied in suit- 
able exercises, especially in the young-adult age- 
group — 25-34 years of age. Some of the instruments 
for these objectives are yet to he developed; those 
that have been designed are properly concealed from 
public view. In consequence, the discussion of out- 
comes other than educational achievement lacks the 
specificity of test items or survey items; rather, 
we deal with important areas which are nontrivially 
represented in the collection of NAEP objectives. 
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We ctlsc anticipate that there will be strong inter- 
correlations among the various items that purport 
to n^.easure some one aspect of adult life: financial 
success, civic activity, intellectual life, humanistic 
or aesthetic experiences, etc. These interrelation- 
ships justify our proceeding without a review of 
specific instrumentation to be used by NAEP* 

We first present some results of Duncan et al • 
(11) , which explore the relation of backaround factors 
to educational attainment, occupation, and income for 
white male adults in Sections 3.2.2 and 3.2,3. Then 
the differences between black and white men are 
analyzed in terms of the same background factors and 
outcomes in Section 3.2.4. Using data from Project 
TALENT, attendance at college is studied for influences 
of SES, sex, and ability in Section 3.3. 

Job experiences are also related to educational 
factors, sex, and race in Section 3,4. The Parnes 
studies (30, 40, 45, 46, 53) review labor force par- 
ticipation, unemployment and rates of pay and are 
discussed in Sections 3,4,2, 3,4,3 and 3,4.4. 

Colem.an (5, p, 275) points out that aspirations 
and miOtivations , especially those "toward further 
education and toward desirable occupations are partly 
a result the home, and partly a result of the 
school. They play a special role, for they are in 
part an outcom.e of education, and in part a factor 
which propels the child toward further education and 
achievement . 

Motivational and attitudinal influences on educa- 
tional achievement were briefly treated in Chapter 2, 
Section 4. We turn to their role as outcomes in 
Section 3.5. 

Section 3.6 summ.arizes the results of all of 
these investigations . 
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3.2 Relation of backcrround factors to education, 
occupation I and incorre 



3.2.1 Approach 4^ 

For economy of exposition, we begin with an 
analysis of the relation of SES-type background 
factors — father's education, father's occupation, and 
nuirJ^er of siblings — to educational attainment, oc- 
cupation, and inccne, along with the most important 
interactions among these three ou^comes. By this 
device, we cover some essential ground with a single 
model, turning to other models and other studies for 
extension of results after the general form of the 
relationships hds been set forth. 

How do each of the three background factors 
affect educational attainment? Occupation? Income? 
And how does education affect occupation and income? 

Duncan et al (11) investigate these questions 
with data from the March 1962 Currant Popu.lation 
Survey (CPS) of the U.S. Bureau of the Census, which 
included a supplemental questionnaire, "Occupational 
Changes in a Generation," as well as the standard 
CPS items. Duncan and others devf^loped the supple- 
mental instrument. A Sur.pUj of 20 ,700 respondents 
represented about 45,000,000 men in the U.S. civilian 
noninstitutionc;! population between the ages of 20 
and 64. 



3.2.2 A Simple Model of Ra^^kground Factors and 
OutcoH'es 

For simplification, the initial model is re- 
stricted to non-Llack m.en with nonfarm background, 35 
44 years of age, m the experienced labor force. 
(This imposes some problems on the interpretation 
cf th3 data for NAEP purposes, to which we return in 
Section 3.2.3.) The model is extended to ethnic- 
group membership in Section 3.2.4. 

The model is represented by Figure 2 from 
Duncan et al (11, p. 39). The figures on the lines 
are path coefficients, path is not shown if the co- 
efficient is less than 0.05 in absolute value. 
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Figure 2. Illustration of Duncan's Path Coefficients 




^.75 

The straight- nes show significant influences, 
with the arrowhead, indicating the presumed direction 
of influence. The curved lines with arrowheads on 
both ends represent associations with no such pre- 
sumptions. The fiaures are path coefficients (or 
beta-coef f ici<?nts) . Arrows from outside the network 
represent uncorrelated residuals at the specified 
nodes. (A complete exposition of the model and its 
formal properties appears on pp. 18-30 of Duncan 
et al.) . 

Background factors (e.g., father's occupation) 
icrei?-::!. influence both the education and occupation 
of the respondent (his'son, in this case). They also 
operate through iKtevve^.ing variables , affecting 
occupation through education and 1961 income through 
both education and occupation. (1961 data are the 
latest full-year incomes reportable in March 1962.) 



3.2.3 Discussion of the Model 

Several comments on this sample model are in 
order, in the context of the present study: 

a. The model postulates diveoticr.s of influence as 
well as rea^iA^^es of association in some cases. 
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These are plausible choices for the model dis- 
played, with valuwiblo information on direct and 
indirect influences of background factors. 
{Duncan states the around rules impeccably in 
Chapter 1. ) 

b. The large contributions of residuals for inter- 
vening variables and outcomes (0.85, 0.75, and 
0.89) demonstrate that the data fall far short 

of "explaining" variations in educational attain- 
ment, occupation, and income. 

c. The substantially complete explanation of out- 
comes and intervening variables is Kcr the prin- 
cipal objective of the NAEP project; hence the 
relatively small portion of variation associated 
with these background factors is net faral. One 
of the objectives of NAEP is to construct valid 
:?.:^:ra>': 3CK -:rcuts for the assessment of changes 
over tim.e of scores on NAFP tests and exercises, 
protected from misleading and invalid comparisons 
because of changing composition (over time) of 
populations, especially in the dimensions of the 
background factors. Otherwise changes in scores 
for groups could occur from one period to another, 
even though no change occurred in the tested 
performance of any subpopulation . 

d. The age interval (35-44 years) of the CPS data 
does not overlap the NAEP older-aqe group (26-35) 
in the above diagram. However, the simple corre- 
lations of the two age intervals are quite similar 
(page 38, referred to above), as are the partial 
regression coefficients (page 40), Duncan com- 
ments, "For illustration, the results are dis- 
played in the araphic form for only one cohort, 
men 35-44 years old in 1962. Most of the impor- 
tant features of the results are, however, shared 
by all the cohorts." (p. 40) 

e. The analysis is restricted to "experienced" labor 
force. It would therefore omit the relatively 
few men entering the civilian labor force for 
the first time — probably mostly veterans. 

NAEP does not have a cohort for the years of 
heavy entrance of male full-time job-seekers — 
18-24 when the specific experience of this 
part of the adult life cycle would be most 
important . 
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f. The analysis excludes women. We present some 
results for women below, 

a. The selection of a restricted part of the popu- 
lation for the analysis would have the effect of 
reducing the sources of variability, i.e., those 
associated with race, sex, very young adulthood, 
farn background. These attenuations in variabil- 
ity could lead to reductions in correlations 
and possibly th« size of regression coefficients. 
In consequence, the importance of the influential 
variables is probably understated in the model, 
if one is interested in the population at large. 

In the next section we review the results for 
an auamented list of backqround factors. 

3.2.4 Comparisons of Outcomes for Blacks and Whites 

The discussion immediately above was restricted 
to white men; we now introduce the ethnic-membership 
distinction, attempting to explain the same outcomes - 
educational attainment, occupation, and income — in 
terms of SES, number of siblings, and, additionally, 
race. Table 47 is taken directly from Duncan et al. - 
his Table 4.3. 

The differences between Whites and Blacks are 
shown on the last line in original units — siblings, 
years of schooling, occupational score, and dollars 
of income. 

The sequence is so arranged that each column is 
estimated as subject to influences appearing to its 
left (family SES is taken as independent, and does 
not have its own column). 

The several components of each difference are 
estimated by path-coefficient techniques. Black 
means for explanatory variables were inserted into 
White regression equations to estimate "equivalent" 
Black values. 

The raw data show average years of schooling 
for Blacks of 9.4 years, for Whites 11.7 years, a 
difference of 2.3 years. One is interested in seeing 
how much of that difference is "due to" {in the 
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arithmetical sense - not cause and effect) differences 
in SES and family size. The second column of Table 
47 provides an answer. The interpretation of the 
second column is that 1.0 years of the difference 
(over 40 percent) is accounted for by the racial 
difference in SES (assuming that the White regression 
applies to Blacks); 0,1 years more by family size, and 
1.2 (half) of the difference is due to other factors* 
The final component is the estimate of difference in 
educational attainment if the Blacks had the same 
SES and family size as Whites, 

This result is for a particular population and 
date and for this particular model; a different col- 
lection of explanatory variables could change the 
relative importance of the components of the racial 
differences. The 1.2 years "unexplained" could be 
regarded as a racial difference, within the restric- 
tions just stated, and without further identification 
or measurement of additional influential variables. 
This result warns of the need to "control" race in 
the comparison of NAEP scores for educational 
attainments from one year to another. 



:j jurat : OK 

The difference in occupation scale is 23,8 
points, derived from white average of 43.5 and black 
average of 19.7. The scale is an occupational SES 
by Duncan (4 7) ("A Sociometric Index for All Occupa- 
tions," in A. J. Reiss and others, Occupations and 
Social Status , New York, Free Press, 19(51) from Census 
classification of occupations. 

While family SES is important (6.6 points), 
about half, again, of the racial difference is allotted 
to other influences that SES, family size, and 
education . 

Again, the treatment of occupation as an outcome 
of education (4.8, or 20 percent of the racial differ- 
ence) and background factors required separate com- 
parisons for at least these two ethnic classes in 
comparing NAEP scores for occupation over time. 
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In this nodel (see also earlier Fiqure 2) Incorre 
is regarded as being influenced by all four of the 
other factors. Education accounts for $520 of the 
total difference of $3,790, or about 14 percent. The 
residual for other factors is $1,430, about 38 percent 
of the total racial difference. 

Again, ethnic aroups should be kept separate in 
comparing XAEP scores for income, in order to avoid 
differences over time caused by chanaes in ethnic com- 
position within any con^.parison aroups. 



3.3 SES, Ability, and Attendance at College 

In the previous section, educational attainment 
was treated as an outcome; and the influences of back- 
ground factors and other variables were described. 
A particular aspect of educational attainment is 
attendance at colleae. The following treatment il- 
luninates two ratters not included above: (a) the 
interactions of SES and ability, as related to col- 
lege attendance; and (b) results for both males and 
females . 

Tables 48 and 49 are taken from Project TALENT 
(14). They show consistent relationships between the 
probability of entering colleae and a combination of 
socioeconomic status and a measure of ability. There 
are consistent increases in probability of attending 

Table 48. Prcpbability of a male entering college by 
ability and socioeconomic index. Project 
TALENT . 



Socioeconomic Quarter 



Ability 


Quarter 


Low 
1 


2 


3 


Hiqh 
4 


Low 


1 


0 .06 


0.12 


0.13 


0.26 




2 


0.13 


0.15 


0.29 


0.36 


High 


3 


0 .25 


0.34 


0.45 


0.65 


4 


0.48 


0.70 


0.73 


0.87 
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colloge with increased ability and with socioeconomic 
level and also with increases in the combination. The 
combination of lowest SFS and lowest ability yielded 
probabilities of attending colloqe under 10 percent 
for both sexes, and high SES combined with high ability 
associated with probabilities of attending college be- 
tween 80 and 90 percent. The patterns for the two 
sexes were quite similar* 

Table 49. Probability of a female entering college 

by ability and socioeconomic index, Project 
TALENT. 



Socioeconomic Quarter 



Ability 


Quarter 


Low 
1 


2 


3 


High 
4 


Low 


1 


0.07 


0.07 


0.05 


0.20 




2 


0.08 


0.09 


0 .20 


0.33 




3 


0.18 


0.23 


0.36 


0.55 


High 


4 


0.34 


0.67 


0.67 


0.82 



Note that increased ability has a much greater effect 
than increased SES for both men and women, as measured 
and scaled in this study. 

The analysis did not include the dimension of 
ethnicity. It is probable that a substantial part of 
the effect of membership in ethnic groups is already 
accounted for in the SES measurement, since the SES 
index is a composite of nine measures including value 
of home, family income, father's occupation, and the 
education of father and mother, all of which will 
reflect some ethnic differences. This is not to say 
that no additional information will be provided by the 
addition of an ethnic dimension or that the differences 
between the sexes of ethnic minority groups would not 
be revealing. 

Project SCOPE showed the unequal racial distribu- 
tion of 9,735 entering college freshmen in California, 
Illinois, Massachusetts and North Carolina. Tillery 
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(49, p, 79) presents the following data on racial 
distribution of freshmen enrollments: 



Percent of Freshmen 



Level of Institution 



White 



Nonwhite 



Less than 2 years 

2 years, less than 4 years 

4 years, B.A. 

More than 4 years, M.A. 

More than 4 years, Ph.D. 



75 
87 
88 
93 
94 



25 
13 
12 
7 
6 



The, higher percentage nonwhite in less-than-two-year 
institutions compared to institutions with higher 
level programs is evid^^nt. 

Project SCOPE summarized other facets of college 
attendance, aspirations and changes in aspirations 
that are not summarized here, but which provide useful 
background for the researcher interested in this area. 



3.4 Job Experience as an Outcome of Education 



3.4*1 Approach 

ane greatest part of the literature on educa- 
tional outcomes relates directly to academic achieve- 
ment ih some form. This may partly be explained by 
the relative ease of obtaining test results, grades, 
and related data. In one view of educational goals, 
the payoff in education should also show up in the 
early adult years in terms of job experience. It 
should not be presumed that other outcomes, especially 
taking care of children and households, are not impor-- 
tant aspects of life which must be related to educa- 
tional experience. However, a well-established goal 
of the educational system is preparation for useful 
employment — either paid employment or voluntary work 
on some meaningful activity — presumably related in 
some way to skills and abilities developed in the 
school years . 
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For all aspects of education with a strong vo- 
cational leaning, e.g., '^commercial or secretarial" 
tracks or vocational subjects, the job experience 
is really a validation of the entire educational 
process. It is the real-life proof that learning and 
indeed qrades on vocationally-oriented subjects do 
predispose a successful student to a successful work 
career . 

The relative paucity of data miaht be understood 
most easily in terms of the cost and difficulties of 
obtaining quality data on both educational experiences 
and job histories for the same individuals. The most 
direct approach to this problem is the longitudinal 
survey . 

For our purposes, the studies of Herbert Fames 
at the Ohio State University Center for Human Re- 
sources Research (30, 40, 45, 46, 53) are the most 
relevant. Since the base-year survey was 1966, and 
there is a lag of several years between the initial 
survey and the reports which analyzed two and three- ^ 
year followups, there are not yet many data for those 
in the first samples who have subsequently entered the 
labor rarket. Of the four groups of United States 
population sampled by Parnes, only the young women 
aged 14 to 24 would have had substantial numbers who 
were in school in the base survey year. 

Other studies presumably will throw light on the 
subject. The Longitudinal Study of Educational Effects 
of the National Center for Educational Statistics con- 
ducted a base-year survey in the spring of 1972, with 
reports now well along in preparation but not yet 
available. The first-year followup is just now in 
preparation. The original sample was of high-school 
seniors, so the age group is quite well chosen for 
examining the transition from the educational system 
to the job r^.arket as those v;ho take no further school- 
ing seek jobs at once and the other groups gradually 
drift into the job market after their various kinds of 
post-secondary educational experiences. It will be 
several years before these data become available for 
the question at hand. 

The American Council on Education sample of en- 
tering freshm.en also has a longitudinal cohort which 
has areat potential for associative studies. The data 
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bank is described by Bayer, et al. (2) and examples 
of normative studies are Creager, et al. (8) and 
Bayer, et al. (3). One can hope that these excellent 
summary statistics will eventually be related to 
background factors. 

In each subsection which follows, the data for 
males are presented, followed by corresponding infor- 
mation for females. 



3.4.2 Labor-Force Participation 

Turning to the Parnes studies, we first present 
information on the labor-force participation rates 
for males 14 to 24 years, who are not enrolled in 
school (see Table 50). The numi)ers shown on this 
table are population estimates, obviously, rather 
than samples. Hence the numbers of blacks who have 
completed elementary school are probably represented 
by quite small numbers in the sample. Not unexpect- 
edly, the labor-force participation rates for boys 
14 to 17 years of age who have not completed elementary 
school are low — 74 percent for whites and 84 percent 
for blacks. By age 18 to 19, much of the gap between 
these dropouts and those with at least '^ome high-school 
education has disappeared. The labor-force participa- 
tion rates for the highe ■; age groups for „hose who 
have not completed elementary school are not signifi- 
cantly different from those who dropped out some time 
during high school. Throughout the table, the labor- 
force participation rates for young white males tends 
to be higher than for young blacks, but by age 22 the 
differences practically disappear. 

For the entire age group 14 to 24, those not 
entering high school have definitely lower participa- 
tion rates, but they will not be evenly distributed 
through this age interval . 

A substantial part of the explanation of non- 
participation in the labor force is traced to poor 
health or physical condition. For example, "white 
youths with some health problems have a participation 
rate of 90 percent compared with 97 percent for those 
with no such problems." 
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Table 50. Labor force participation rates, by high- 
est year of school completed: Males 14-24 
years of age not enrolled in school, by 
color - Parnes data 



Whites Blacks 







Labor 




Labor 






force 




force 






partici- 




partici- 


Highest 




pation 




pation 


year of 


Total 


rate , 




rate 


school 


number 


survey 


number 


survey 


completed 


(thousands) 


week 


(thousands) 


week 


8 or less 


699 


90 


227 


92 


>11 


1,188 


97 


323 


91 


12 


2,573 


97 


346 


96 


13-15 


607 


98 


46 


100 


16 or 










more 


335 


96 


21 


100 


Total 


5,402 


96 


963 


94 


Source : 


Parnes, et al 


. (40, p. 


61) 





A major explanation of labor-force participation 
of males 18 to 24 years of age is their marital 
status : 



Whites Blacks 

Married 100% 99% 

Other 93% 92% 

Average 96% 95% 



Within this age group, there seems to be no difference 
traceable to the wife working or not working. 

Parnes also conducted a brief analysis for the 
u??>: c: l:oal UKe'^r: loument rates and found no 
particular differences in labor force participation 
exce^. t among blacks where the relationship is the 
reverse of that postulated by the "discouraged worker 
hypothesis." The black participation rate was 91 
percent where 1960 unemployment was under 4.2 percent. 



and the participation rate was 96 percent where un- 
enployment was 6.2 percent or more. Parnes calls this 
"inexplicable" but ic might be traceable to the 
pressure on young men to seek jobs when other wage- 
earners in the household find themselves unemployed 
or working at less than their hiahest skill {and 
income), or working only part time. 

Among women, educational attainment and the 
school curriculum are influential in their job 
experience. These matters are discussed under the 
section on rates of pay {Section 3.4.4) because of 
the close interrelationships. 



3.4.3 Unemployment 

We turn now to ur.er-plc:<":er.t ratee of those aot- 
:» :::':. th,e laloi' :'cr:7e. The data are shown in 
Table 51. "With some exceptions, unemployment rates 
of male youth tend to vary systematically according 
to school enrollment status, color, and age" {40, p. 
65). Unemployment tends to be considerably higher 
for students than for non-students. {This might 
represent the quite restricted conditions under v;hich 
full-time students can work.) Among both those in 
and out of school, the rate is higher for blacks than 
for whites. Unemployment also decreases with advanc- 
ing age, but part of this is probably explained by the 
differences between students and nonstudents. in 
Table 51, looking only at those not enrolled in school, 
there is a sharp drop from age 16-17 to age 18-19 
and a further drop — much smaller — from that group 
to the 20 to 21-year-olds, Above this age, the pattern 
becom.es indistinct. Again, it should be noted that 
these very small percentages unemployed (in the upper 
age groups of the 14 to 24-year-olds) probably repre- 
sent very few indi/iduals in the sample, so much of 
the irregularity might be traceable to sampling vari- 
ances for these very small cells. 

There is a fairly strong relation between unem- 
ployment rates and hiahest year of school completed. 
(See Table 52.) 

The unemployment rates for those who have not 
completed hiah school are much hiqher than for those 
who have completed high school but had no further 
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Table 51, Percent unemployment rates, by school 

enrollment status and age: males 14-24 
years of aqe in the labor force, by 
color - Fames data 



ocnooi enroiimenu 
status and age 


Whites 


Blacks 


Total 


Enrolled in school 








14-15 


^ A Q 
1 4 . s 


17 '\ 


15 2 

X ^ . ^ 


16-17 


1 "5 Q 


9 Q 

^ ^ . 7 


14 2 

X t • w 




i. J ,H 


21 2 


13.8 


20-21 


4.0 


3.2 


4.2 


22-24 


3.7 


2.8 


3.6 


Total 14-^4 




1 8 5 


12.6 


Not enrolled in school 








14-15 




It; n 
X D . u 


6 o . o 


16-17 


Q ^ 


xo . ^ 


Q 7 


18-19 


* • ^ 


/ • 0 


4 7 


20-21 


3.0 


2.4 


2.9 


22-24 


1.0 


3.1 


1.3 


Total 14-24 


3.0 


5.5 


3.4 


Total aqe group 






15.6 


14-15' 


15.4 


17.1 


16-17 


11 .7 


21.4 


13.1 


18-19 


8.4 


10.3 


8.6 


20-21 


3.3 


2.5 


3.2 


22-24 


1.4 


3.3 


1.6 


Total 14-24 


7.2 


10.2 


7.5 



Source: Parnes, et al. {40, p. 66) 



education. There are further declines for additional 
attainment through completion of high school (with 
the anomaly of the 13-15 grade group for whites) • 
Overall, the blacks have hiqher unemployment rates 
than the whites. 

Not only does school attainment relate to levels 
of unemployment, but the high echocl Qurriculwr) also 

IK :>-'::<eKoe. The levels for "general" education 
are high for both whites and blacks; the vocational 
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Table 52. Percent unemployirent rates, by age and 

highest year of school completed ; males 
14-24 years of age in the labor force and 
not enrolled in school, by color - Parnes 
data 

Highest year of 



school completed 


Whites 


Blacks 


Total 14-24 






Less than 12 


4.9 


7.7 


12 


1.8 


3.3 


13-15 


3.7 


0.0 


16 or more 


0.0 


0.0 


Average 


3.0 


5.5 



Source: Parnes, et al, (40, p, 74) 



curricula are also high. The low unemployment rates 
are found among students who took commercial or 
college-preparatory courses (see Table 53), 

Table 53, Percent/ unemployment rates, by high school 
curriculum: males 16-19 years of age in 
the labor force and not enrolled in 
school*, by color - Parnes data 



High school 
curriculuir. 


Whites 


Blacks 


Vocational 


4.1 


13.9 


Commercial 


0.0 


0.0 


College Preparatory 


1.6 


4.5 


General 


6.9 


13.9 


Total 


4.9 


11.8 



★ 

Includes only those respondents who have completed 
at least one year of high school. 



Source: Parnes, et al • (40, p, 75) 
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It should be noted that Table 53 is not control- 
led for number of years in school. The population is 
restricted to those males in the samplf^ who have 
coinpleted at least one year of hiqh school. Since 
the college-preparatory students have the lowest drop- 
out rate, it is possible that a number of vocational 
and general-education students ha\ already dropped 
out of high school by the time the fjurvey asked 
whether they were unemployed. The curriculum desig- 
nations are therefore confounded with educational 
attainment, which was shown above to be related to 
unemployment rate . 



3.4.4 Rates of Pay 

We turn finally to another aspect of work history 
as an outcome of educational and ether influences — 

f^ii. Levels of pay are related to educa- 
tional attainment. This is not surprising in vi'^w 
of the rather close relation between education and 
occupation, and the superior pay of those oc'cupations 
that go with higher educational attainment. Some 
details are given in Table 54* 

Not surprisingly, the analysis shows that young 
men completing 12 or more years of school have higher 
hourly rates of pay than those who completed fewer 
years no matter whether one looks at craftsmen or 
operatives, or blacks and whites. Further, additional 
training outside of the regular school shows consistent 
increases in pay with the addition of such programs. 
The remaining striking feature of the table is the 
differential in hourly rates of pay between blacks 
and whites even after controlling for educational 
attainment and for classification as craftsmen or 
operatives. The control of occupation is not very 
precise, since there are many kinds of craftsmen 
(including foremen) and many kinds of operatives, but 
the dif ferenirials are large enough to be impressive 
even with the loose controls offered. 

The rates of pay of ironen depend substantially 
upon their occupations; these, in turn, reflect educa- 
tional attainm^ent and school curriculum. The major 
racial differences between rates of pay arise through 
unequal access to favored occupations r-ather than in 
differencen of pay within classes of occupations. 
These results are presented in Tables 55 and 56. 
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Table 54, Mean hourly rate of pay of craftsmen and 
operatives, by highest year of school 
completed and by extent of vocational 
training outside of regular school: em- 
ployed male wage and salary workers 20-24 
years of age not enrolled in school, by 
color - Parnes data 



Whites Blacks 





Crafts' 




Crafts- 




Education and 


men , 




men, 




Training 


Foremen Operatives 


Foremen 


Operatives 


Highest year 










of school 










completed 










11 or less 


$2.47 


$2.39 


$1.47 


$1 .72 


12 or more 


2.76 


2.73 


2.23 


2.19 


Average 


2.65 


2.60 


1 .86 


1.99 


Extent of 










training outside 










regular school 










None 


2.57 


2.36 


1.84 


1.87 


1 type of 










program 


2.66 


2.75 


(*) 


2.29 


2 or more types 










of programs 


2.78 


2.94 


(*) 


{*) 


Average 


2*65 


2.60 


1 .86 


1.99 


Means not shown 


where 


sample cases 


number 


fewer 


than 30. 









Source: Parnes, et al. (40, p. 98) 



The first column of Table 55 shows the strong 
relationship between professional and technical oqqu- 

>:j and educational attainment. Note the very 
high percentages; for both races, who have at least 
completed the equivalent of college. College gradua- 
tion is rare for all other occupations, and for both 
races ; with the exception of Blacks who are non-farm 
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nanagers and proprietors. If one searches the table, 
it is possible to find a good deal of heterogeneity 
throughout the pattern displayed, including the sub- 
stantial variability of educational attainment of 
people in clerical and sales occupations. However, 
there is a fairly consistent pattern of those in 
domestic service and farm occupations having quite low 
educational attainment, again for both races. To a 
slightly lesser extent the same is also true of the 
other blue-collar occupations. 

Hourly rates of pay are also related to cduoa- 
t:/kx- : :^;>:-r>: r as shown in Table 56. It will be 
noted that many of the entries on this table are 
based on quite small cells in the sample. However, 
there are consistent relationships in the average for 
all White women and the average for all Black vomen, 
with the increasing hourly rate going up with years 
of education on most of the lines. The pattern of 
differences in hourly rates of pay, controlled for 
both occupational group and years of education, fails 
to show the consistent pattern that applied to Black 
men and White men. In general, the gain in hourly 
rates with increased schooling is somewhat greater 
for Black women than for White women. Parnes suspects 
some of the occupational classification in this ana- 
lysis on the grounds that a number of "professionals" 
are in teaching, an occupation which generally commands 
a higher-than-average salary for professional-technical 
women . 

3' .■>: ?:iVV'.-^ul7 and subject specialization 
have repeatedly been shown to influence occupation. 
Among wonen , typing and sometimes shorthand are the 
most frequent paths to eerly employment, as shown in 
Table 57. 

A review of the occupational distribution of 
white wor.en shows a preponderance of clerical and 
sales jobs for a broad range of educational attain- 
ment, being exceeded by blue-collar jobs only for 
those who do not complete high school. Two-thirds 
of those with more than hiqh school education have 
clerical and sales occupations, with most of the x-est 
beina professional and managerial. The second line 
of the table shows that thc^e with typing and short- 
hand rrove substantially into these kinds of jobs. It 
should be noted that many of those without these 
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Table 57. Occupation of longest job between school and 
first marriage, by highest year of school 
completed, whether took typing and/or shoi.-t- 
hand in high school, and color* - Parnes 
data for women. (Percentage distribution) 

9-11 years 



No typincT Typing Total 

Occupation of or Typina and or 

first job shorthand only shorthand average 



WIIITF? 



Professional/ 



manaaerial 


1 


0 


5 


2 


Clerical and sales 


28 


42 


55 


37 


Blue-col lar 


48 


32 


29 


40 


Oorestic service 


1 


3 


3 


2 


Nondonestic 










service 


22 


22 


9 


19 


Farr 


0** 


2 


0 


1 


Total percent 


100 


100 


100 


100 


Total nurber 










(thousands ) 


1,065 


483 


385 


1 ,938 


Mori zor.tal 










porcentaoe 


55 


25 


20 


100 



BT-ACK? 



Professional/ 



ranaaer ial 


3 


0 


0 • 


2 


Clerical and sales 


2 


13 


6 


4 


Blue-col lar 


22 


22 


11 


21 


Domestic service 


29 


19 


10 


27 


N'ondorestic 










service 


36 


45 


73 


40 


Far- 


8 


2 


0 


6 


Total percent 


100 


100 


100 


100 


Total nur.bor 










(thousands ) 


293 


50 


22 


366 


Horizontal 










rercentacjo 


80 


14 


6 


100 



* IncludGs only respondents who attendee^ hiah school 

ar.c: those wh.o did not oraduate from col lege, 
** Percentaoe is 0.1 to 0,5, 

Source: Shea, ct al. (45, p. 145) 
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Table 57, Occupation of longest job between school and 
first marriage^ by highest year of school 
completed, whether took typing and/or short- 
hand in hiah school^ and color* - Parnes 
data for wopien. (Percentage distribution) ~ 
Continued 

12 years 



No typinq Typinq Total 

Occupation of or Typinq and or 

first job shorthand only shorthand average 



WHITES 



F'rofessional/ 



r.Jina^ierial 


9 


10 


5 


7 


Clerical and sales 


63 


66 


80 


73 


EUue-collar 


18 


15 


11 


13 


Domestic service 


2 


2 


1 


1 


Noncior.estic 










service 


8 


7 


3 


5 


rarr 


0 


1 


0 


0 


Total percent 


100 


100 


100 


100 


Total r.urber 








(thov.snncis ) 


846 


1 , 900 


3,451 


6,234 


Horizontal 








pe rcentaae 


14 


30 


56 


100 



BLACKS 



Professional/ 



r.ar.a ere rial 


10 


1 


7 


6 


Clerical ar.d sales 


27 


28 


55 


33 


Plue-col lar 


28 


34 


13 


27 


Dcrestic ser'.'ice 


10 


12 


10 


11 


^.■c^.do^"estic 










so r'.' ice 


22 


24 


15 


22 


rarr 


2 


0 


0 


1 


Tctnl porcer.t 


100 


100 


100 


100 


Total nur-ber 










, t!-.cusar.ds ) 


174 


131 


72 


379 


•i-.-^r izcntal 










:;o rcer.taae 


46 , 


35 


19 


100 



* rr.cl-udes or.ly respondents who attendnd hiah school 

.md t^.osc w'r.o did not nraduate fror colleno. 
** r-or.?er.ta:;e is 0.1 to 0.5. 

i=c-.;rce: 5hoa, ot. al. (45, p. 145) 
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Table 57. Occupation of lonqost job between school and 
first marriaqe, by highest year of school 
completed, whether took typing and/or short- 
hand in high school, and color* - Parnes 
data for women, (Percentage distribution) — 
Continued 



13-15 years 

No typing Typing Total 

Occupation of or Typing and or 

first job shorthand only shorthand average 



WHITES 



Professional/ 



rar.aaerial 


26 


24 


18 


22 


Clerical and sales 


62 


67 


72 


67 


Blue-col lar 


8 


8 


4 


6 


Dorestic service 


0** 


0** 


0 


0** 


Nondonestic 










service 


4 


2 


6 


4 


I-'arr. 


0 


0 


0 


0 


Total percent 


100 


100 


100 


100 


Total nurber 










(thousanc's ) 


304 


418 


446 


1,191 


?Jori2ontal 










uercer.taqe 


26 


36 


38 


100 



BLACKS 



Pro f essionnl/ 



ranaaerial 


28 


27 


0 


22 


Clerical ar.d sales 


25 


32 


83 


38 


Blue- col lar 


11 


30 


0 


14 


Dorestic service 


11 


5 


8 


9 


^.'or.dorestic 










service 


26 


5 


9 


17 


Farr 


0 


0 


0 


0 


Total percer.t 


100 


100 


100 


100 


Total r.urLer 










't;-.o"jsar.c:s ) 


42 


20 


15 


77 


ri2or.tal 










tcrcer.tacrt. 


55 


26 


19 


100 



* Ir.cl'udes only respondents who attended hiah school 
a:-l these who nid not araduate fror colleqe. 

* * I-or rent acre is 0.1 to 0 . 5 » 

Sc'.:rce : Shcn , et al . (4 5 ^ p . 14 5) 
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secretarial skills also move into clerical and sales 
jobs except for the less-than-hiah-school-education 
group, where a preponderance of those without secre- 
tarial skills become blue-collar workers or enter 
non-domes^:ic service • 

The pattern among Black women is quite different. 
Blue-collar, non-domestic, and domestic service? dom- 
inate the occupational distribution even for those 
with typing, shorthand, or both. It is not until 
after graduation from high school that clerical and 
sales occupations become important, and then typically 
only for those possessing both typing and shorthand 
skills , 



3.4.5 Summary of Job-Related Outcomes 

In summary, it appears as though the job histor- 
ies of both men and women, for Whites and for minority 
ethnic groups depend heavily upon education. To the 
extent that other variables are important, they seem 
to be the same kinds of background factors which this 
report has already cited as those most important for 
the associative explanation of educational achievement. 

The general picture presented, then, is that the 
selection of background variables for NAEP to collect 
for the explanation of achievement scores also meets 
the requirement for explanatory factors for backgrounds 
other than achievement! educational attainment, 
attitudes important to employment success (see 
Section 3.5 following), and other aspects of adult 
life, employment and occupational aspects of job 
histories, as well as continuation of education for 
each level of education surveyed. 



3.5 Attitudes and Motivations 



3.5.1 Approach 

In Section 2.5 we treatod attitudes and motiva- 
tions as background variables. Here we consider them 
as outcomes, recognizing that they are more properly 
classified as intervening variables. They are at 
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once consequences of earlier educational experiences 
and other factors, and influences in later educational, 
occupational, and other behavior. 

Attitudes toward school (Section 3.5.2) and work 
(Section 3.5.3), job satisfaction (Section 3.5.4) are 
reviewed, followed by educational and occupational 
aspirations (Section 3.5.5), and attitude toward 
government and society (Section 3.5.6). 



3.5.2 Attitudes and Motivations Toward School 

One central question on Coleman's twelfth-grade 
instru:-.ent (Question 59, p. 650) was; ''If sofvething 
>.ir:^Ke:i ^r:^ had :c stop oahocl ncv, how vould 

:..^V;Vr:r" The national distribution of responses 
follows : 

Percent 



Like to quit 2 

Don't care 4 

Would be disappointed 12 

Try hard to continue 36 

Do anythina to stay 45 

(Nonresponse ) 2 



The rost common response, "Do anything to stay" 
showed 45 - 50 percent response for all five regions, 
and for r.e tropolitan and nonmetropolitan communities 
alike. The White majority did not show higher at- 
titudinal scores on this question than Black students 
for all region-comm.unity classes. Some other ethnic 
groups did score lower; 

Mexican-Americans 37 percent 

Puerto Ricans 35 percent 

American Indians 36 percent 

The lowest score ("like to quit") was small 
except for Puerto Ricans (15.9%). 

Other attitudinal questions produced similar 
results. The Southern Region and Blacks reported 
more studying out of school than other groups (ex- 
cept Orientai-Americans) (Q. 61, p. 651). Blacks 
reported less staying away from school because they 



164 



"didn't want to come" than others (again except 
Oriental-Americans) (263, p. 651), Again, the South 
reported a slightly lower rate of voluntary 
absenteeism. 



3.5.3 Attitude Toward Work 

Parne's investigated attitudes toward work, in- 
cluding job satisfaction, importance of money received, 
and other factors. Several of the questions are 
directed specifically tovard women, and they deal with 
problems of child care during the work day, and similar 
items. Table 58 shows percentage differences in moti- 
vation to work at various occupations, by race. The 
data shows strong occupational differences. As antici- 
pated, the professional and managerial jobs give 
"liking the work" far more emphasis than "good wages," 
these scores being identical for Blacks and Whites. 
At the other extreme, Blacks engaged in blue-collar 
occupations and domestic service indicated equal 
motivation for wages and job satisfaction. 

It might be remarked that the finding that 
over 9/lOths of both Whites and Blacks reported 
liking their jobs either very much or fairly well 
might be regarded with some suspicion for some of 
the m.ore menial jobs. Parnec cites other studies 
which display larger percentages of workers express- 
ing dislike for their jobs. The group studied in 
this case is employed women 30 to 44 years of age. 

Bachnan (1) also investigates attitude toward 
jobs. There is only a moderate relationship between 
his values and attitudes and the corresponding items 
in the NAEP objectives for "career and occupational 
development." The Bachman "index of ambitious job 
attitudes" is a composite of "job that pays off" 
and "job that doesn't bug me;" the NAEP objectives 
probably have a num.ber of components that would cor- 
relate well with this index. (Note the comment on 
non-availability of NAEP instruments in 3.1). The 
methodology and background variables are the same as 
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in the discussion of job 
(grades) in Section 2.3, 
p. 143) are as follows: 



information and achievement 
Bachman's data (Vol, Ii, 



„ . Percent of 

Bachman Variables Variability Explained 

Family relations 

(the largest single factor 

contribution) ' 11,2 

Socioeconomic level 

(second largest) 5,5 

All eight background factors 16,2 

All eight background factors 
plus the Quick Test of 

Intelligence ig 5 



3.5,4 Job Satisfaction 



_ Parnes takes up the question of job satisfaction 
with men m Career Thresholds . (40), Again, there are 
differences m job satisfaction from white collar occu- 
pations to blue collar occupations. The differences 
become accentuated as the workers move from less than 
12 grades attained (no difference between white-collar 
and blue-collar for Whites) to a fairly sharp dif- 
ference for those with 13 grades or more — 61 percent 
Of the white-collar workers "like their job very 
much" contrasted with only 43 percent for blue-collar 
at the same educational attainment level. Among 
Blacks, there is an exception to this finding, in 
that 64 percent of the Black white-collar workers with 
less than 12 grades of attainment like their iob very 
much . ^ 



Again, we find the summary picture similar for 
women workers. Occupational level is strongly in- 
fluenced by educational attainment, and job satisfac- 
tion is related to occupation. 

The relevance of these results to NAEP can be 
cited. The career and occupational development ob- 
jectives include (&5) "Have positive attitudes toward 
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work." This unit involves precisely son^.e of the at-^ 
titudes embodied in the Parnes questions — recogniEing 
the bases of various attitudes toward work, value of 
work in terms of societal goals, etc. 

Since NAEP already collects information about 
education and occupations of those responding to the 
exercises, this does not suggest additional background 
variables necessary for the explanation of NAEP test 
results. Rather, it merely reaffirms the importance 
of those influences relating to hiqh educatio^w?.! 
attainment, and probably to achievement. 



3 ,5. 5 Educational and Occupational Aspirations 

Coleman (5, p. 275-281) discussed the educa- 
tional asoirations and the occupational aspiratiors 
of his sample. In response to the question: "How 
far do you want to go in school?" the responses shown 
in Table 59 were given. 

Table 59. Percentaqe distribution of replies of 12- 
grade pupils on "How far do you want to go 
in .school?", for White and Black pupils 
in metropolitan and nonmetropolitan areas 
by rcigion, and for selected minority groups 
for the United States, fall 1965 - Coleman 
data 

Want to do 
professional^ 
VJant to or graduate^ ' 
Race and area finish college wr>rk 

White , nonmetropolitan: 

south 30 13 

southwest 39 20 

North and West 28 14 

white, metropolitan 

Northeast 32 21 

Midwest 



West 



30 17 

South 35 18 

Southwest 35 19 

33 22 
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Table 59. Percentage distribution of replies of 12- 
qrade pupils on "How far do you want to go 
in school?", for White and Black pupils 
in metropolitan and nonmetropolitan areas 
by reqion, and for selected minority groups 
for the rnited States, fall 1965 - Coleman 
data — Continued 

Want to do 
professional 



Want to or graduate 

Race and area finish college work 

Xegro, nonmetropolitan : 

South 27 16 

Soutnwest 30 22 

North and West 19 14 

Negro, metropolitan: 

Northeast 24 18 

Midwest 2 7 19 

South 29 22 

Southwest 34 21 

West 2 8 13 

Mexican Americans,, rc. -^-^1 21 11 

Puerto Ricans, total 18 14 

American Indians, total 22 13 

Oriental Americans, total 33 31 

Other, total 20 17 

Total, all races 30 17 



Source: Coleman (5, p, 283) 



For all races, 4 7 percent want to complete col- 
Icae , with som.e of those indicating even hiaher 
aspirations. When asked about : to no to cc liege, 
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Che answers are still stronqly positive as shown in 
Table 60, 

Table 60 • Percent of 12th-arade pupils planning to 
go to college next year, for white and 
Black pupils in metropolitan and non- 
metropolitan areas by region, and for 
selected minority groups for the United 
States, fall 1965 - Coleman data 



Definitely Probably 
Race and area Yes Yes 



White , nonmetropolitan : 

South 35 25 

Southwest 50 23 

North and West 35 26 

White , metropolitan : 

Northeast 46 22 

Midwest 37 25 

South 41 26 

Southwest 40 30 

West 55 27 

Neqro , nonrr.etropol itan : 

south 30 38 

Southwest 41 41 

North and West 2 2 33 

Negro , netropolitan : 

Northeast 31 31 

Midwest 3 3 38 

South 35 36 

Southwest 4 3 34 

West 4 8 37 

Mexican "ur.ericans , total 26 34 

Puerto Ricans , total 26 27 

Ar:crican Indians, totcil 2 7 35 
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Table 60, Percent of 12th-c7rade pupils planning to 
go to college next year, for white and 
Black pupils in metropolitan and non- 
rr.etropolitan areas by region, and for 
selected minority groups for the United 
States, fall 1965 - Coleman data 
Continued 





Definitely 


Probably 


Race and area 


Yes 


Yes 


Oriental Americans, total 


53 


29 


Other, total 


32 


29 


Total, all races 


38 


27 



Source; Coleman (5, p. 284) 



Notice that the "definitely yes" answers are 38 
percent, but the combination of "definitely yes" and 
"probably yes" are 6 5 percent, well in excess of tne 
47 percent stating that they wished to "at least 
complete colleae." As in other attitudinal questions 
the South and Southwest tend to state more positive 
attitudes than other parts of the country. And the 
White students tend to assign themselves hiqher scores 
than the Blacks. Also, consistent with the patterns 
above, soiree of the other minority ethnic groups score 
low (Oriental-Americans again being the exception) . 
These generalizations apply both to stated wishes and 
to stated plans. Coler.an points out that while fewer 
Blacks have definite plans to go to college, fewer 
also have definite plans not to attend. "This indi- 
cates the lesser concreteness in Blacks* aspirations, 
the v:reater hopes, but lesser plans" (p. 279). 

Those data do not allow for explanations beyond 
ethnic aroupinas and reqions of the country. In the 
section that follows, Bachman (1) relates occupational 
aspirations and colleae plans to the Quick Test and 
back.rround factors, but he has no educational inputs 
or explanatory variables as such. After summarizing 
these results, we turn aaain to the Parnes studies 
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whore young adults' occupational aspirations are 
related to a number of educational characteristics 
(but not to achievement scores), 

Bachman's index of self-concept of school ability 
was formed frop. answers to three questions (1, Vol, II, 
p, 92), 

• How do you rate yourself in school ability com- 
pared with those in your grade in school? 

• How intelliaent do you think you are, compared 
with other boys your age? 

• How good a reader do you think you are, com- 
pared with other boys your age? 

He found intelligence (as measured by the Quick Test) 
to be the strongest predictor of self-concept, ac- 
counting for 21 percent of the variation in the self- 
concept index. He also found that he could account 
for 16 percent of the variation in self-concept by 
eight background variables (indices) whose simple 
correlations (as measured by Eta) with self-concept 
are listed below: 



Socioeconomic level 0,33 

Number of siblings 0,21 

Broken hom.e 0,07 

Family relations 0.19 

Religious preference 0,18 

Family political preference 0.13 

Comxiunity size 0.11 

Race 0.06 



Note again the dom.inance of socioeconomic level which 
alone accounts for 11 (0,33 squared) of the 16 uercen- 
taae points of variation explained by all eight back- 
ground variables . 

He also found that combinina scores on the 
Quick Test with scores on the eiqht background factors 
permitted him to account for 29 percent of total 
variations in self-concept of school ability. Note 
that cause and effect are not to be implied from 
these data, since one could easily arnue that self- 
concept is one of the determinants of achievement 
and the Quick Test has a strong relationship to 
achievement , 
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Bachran also investiaatod a nuniber of other 
affective reasures. Table 61 sunnarixes soire of his 
principal results. Faruly relations, an index of 
2! itens dealing with relationships between respondents 
and their parents, emeroes as the dominant predictor 
for seven of r-he nine affective variables shown in 
Table 61. For these jeven out cones, socioeconomic 
level alone accounts for no rore than five percent of 
the variation. Thus, it appears that if outcomes of 
the kinds listed in Table 61 are to be adjusted for 
background, other variables than SFS will have to be 
used. It could easily be araued that family relations 
is not a pure background variable since it can be 
influenced to sore extent by education and social 
action proarans. The Bachm.an study shows convincing 
evidence of its importance, however. 

In the opening year of his five-year lonairu- 
dinal study, Parnes investiaated the educational 
aspirations of males 14 to 17 years of aae, as shown 
in Table 62. Parnes comr.ents that the general pattern 
is unrealistic in view of its implications for the dis- 
tribution of occupation in the economy and he predicts 
that the level will drift down in the followup years 
of the longitudinal survey. However, in the first 
followup survey (1967) this pattern really does not 
yet emerce. The whites lowered their educational 
objectives 15 percent, while the blacks lowered ob- 
jectives by 20 percent. However, approximately 14 
percent of both color aroups raised their sights for 
additional education, yieldina trivial net declines. 
In aeneral, the highest occupational and educational 
aspirations "are associated with urban rather than 
rural residence, hiah socioeconomic status of family, 
enrollment in col letre-preparatory curriculum., positive 
attitucios toward school, spondina above-averacie amounts 
of tiro on hom.ework, and havina above-averaue knowl- 
edtTC of the world of work" (40, p. 185). 



3.5.6 Attitude Toward Government and Society 

As in attitudes toward jobs, Bachnan h.as a som.e- 
w:;at difforor^t approach with respect to attitudes 
toward society than seem to be implied by the XAI.T 
Ci t i 2en.s::ip 'Objectives. He scales "political knowl- 
o::ne" Ly idt\^.t i f i cat if^n of student's senators and a 
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Table 62. Educational aspirations: males 14-17 years 
of age enrolled in elementary or high 
school, by color - Parnes data 

Percentage distribution 
Nurr^ber of years of . . — 



education desired 


WHITtS 


BLACKS 


TOTAL 


12 or less 


27 


36 


28 " 


14 


12 


14 


12 


16 


44 


42 


43 


More than 16 


18 


9 


16 


Total percent 


100 


100 


100 


Total number 








(thousands ) 


5,298 


827 


6,125 


Source: Parnes, et 


al. (40, p. 


174) 





few other high officials (1, Vol. II, Table 8-9 on page 
156), whereas the NAEP citizenship objectives relate 
principally to the structures and functions of govern- 
ments and to the citizen's participation in civic 
life. The explained variances in political knowledge 
is low in any case: 15 percent of the total variabil- 
ity for the eight backarcund variables and 21.7 for 
these plus Quick Test scores. (1, Vol. II, Table 8-10 
on page 157.) 

There are other overlaps: NAEP's concern for 
welfare and dianity of others, rights and freedoms 
of all individuals maintainina law^ and order (all 
fror. the citizenship objectives) m:Lght relate to 
Bachnan's i-.^ whose &i< scales comprise 

social responsibility, social skills, honesty, kind- 
ness, self-control, and reciprocity. The only con- 
sequential backaround variable family relations 
associates with 12.5 percent of the total variance 
cf the social values composite scale; the eiqht back- 
ground factors explain 15.1 percent and these plus 
Quick Test account for only 16.8 percent, i.e., leav- 
ir T alnost 85 percent of the variation unaccounted for 
(1, Vol II, Table 8-1 on page 140). 
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3.6 Surrciry of Findinas for Outcomes Other Than 
Achievement 

NAEP objectives cover a variety of behaviors 
that could be regarded as educational outcomes. In 
this chapter we reviewed some studies that investi- 
gated the relationships of background factors to some 
of ti^ese outcomes. 

SES — parent's education and occupation, and 
farily size proved to be ir.portant enough in the 
deterrination of eventual educational attainment, 
occupation, and income that comparisons of NAEP scores 
would be fostered by control of these sources of 
variability. Memibership in ethnic aroup also is 
associated v;ith differences in outcomes, and also 
should be controlled in order to avoid m.isreading 
changes in ethnic composition as valid trends or 
differences in NAEP scores. 

Sim.ilar results were also found for SES and 
attendance at college; but here a measurement of 
student ability also played a major role. 

Job experiences also were conditioned by SES, 
especially by occupation of the head of the household. 
It\'as in* occupation and income that m.aior racial 
differences appeared, and also the interaction between 
race and sex; the jobs evidently available to black 
wor.en showed a substantial waae disadvantaae , even 
when controlled for parent's occupation, years of 
education, and curriculum.. 

Overall, the portion of total variability ex- 
plained is fairly sm.all, indicating the presence of 
ir.pcrtant influences not included in the model or 
the analysis. However, backaround factors are too 
influential to neolect in making com.parisons of NAEP 
scores . 
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CHAPTER 4 



CONCLUSIONS 



The principal larqe studies investigated show 
that one can expect to account for between 20 and 50 
percent of the variation in acadeir.ic outcomes (as 
measured by test scores) by variation in sex, race, 
hor.e and family background, school characteristics and 
motivations, expectations, attitudes, end desires of 
individual students. Within this range there is 
substantial variation in association between back- 
ground variables and outcomes, depending upon the 
nature of the outcome, the age group of the students, 
and the specific background factors considered. 
For example, sex is a more important predictor of 
scores in twelfth-grade science than in science scores 
for ten-year-olds, or (let's say) scores in reading 
at any age . 

Other outcom.es such as college attendance, 
occupational aoals and achievemient , self-esteem, 
educational attainment, and societal attitudes are 
generally related to the same kinds of background 
variables. For example, socioeconomic status and 
ability are primary determinants of college atten- 
dance, but the relationship of the child to his 
family is an important determinant of attitudes 
toward school, self-esteem and social attitudes. 



4.1 Measures of SES 

Alm»ost every major study has included some mea- 
sure of socioeconomic status (SFS) . One can expect 
SES alone to account for between 10 and 25 percent of 
the variation in academic scores. Most comjnon mea- 
sures of SES include occupation of parents, education 
of parents, and items in the home. 

Occupation of father (or if no father in the 
hom.e, of the m.other) is usually obtained from teachers 
or other school personnel for children in the lower 
grades and from the students themselves in the upper 
grades and high school. Sometimes the response is 
sim.ply a written reply to the question, "v;.\7r Jcr- 
*''■•" : 'r) Answers are subse- 

quently coded into from three to over 100 classes. 
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The Internnt.lonal Assej;?;nents have used nlno classf^s 
with codes that are approxipately linearly related 
(by presumption) with incon^e • Bachman (1) and others 
have used Duncan's scale (47) which-contains over 100 
catecfOries , 

The other common mode of recording occupation 
is to provide a precoded scale and to permit the 
pupil (or teacher) to select the cateaory most nearly 
like the father's occupation. Coleman (5) used ten 
categories for this purpose. There is insufficient 
e%'idence in the literature to pern^it one to choose 
between the two methods of recordinq occupation on 
the arounds of accuracy. However, the preceding of 
occupation by the respondent himself is substantially 
less costly and appears to give satisfactory results. 

While frequently only the occupation of the 
father is requested (replacing it by occupation of the 
r.cther if there is no father) it is comjnon practice to 
request educational attainment of both father and 
r.other. When one is not present the educational 
att.-^inrent of the other is used for both. Again, the 
response is usually given by thp teacher for younger 
^/rades and by the pupil himself for upper grades. 

Fducational attainm.ent is sometimes recorded 
into precoded classes such as: less than eighth 
.;rac;e, eighth arade but no hiah school, some high 
school but did not graduate, hiqh school graduate 
but nc college, sore college but did not graduate, 
college czraduate but no postaraduate work, and some 
crraduate school. In other cases, such as the Inter- 
national Assossr.ents , attainment has been recorded 
in terms of number of years of form.al schooling. 
There is little evidence of difference in predicta- 
bility and the forrer method seems more natural for 
L tC5» studer. ts . Whether there are enouah students 
whose parents were educated in a foreian country to 
r.aV.e years of schooling a preferred method of re- 
cording is a factor to be considered. 
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^ great variety of items in the home has been 
considered by various researchers. However, they tend 
to be in one or more of three classes: 

• Those that represent e- onomic status (e.g., 
automobile, telephone, TV, etc J 

• Those that represent an environment conducive 
to educational attainment (e.g., books in 
the horr.e , daily newspaper, encyclopedia, dic- 
tionary, etc,) 

• ThO;Se that represent a family interest in a 
specific subject matter such as art, music, 
literature, or science (e,a,, musical in- 
struments, art and literary magazines, 
paintinas, scientific journals, etc.). 

The first two categories are of interest to all 
educational outcomes, and the third category is 
tailored to specific educational outcomes. This 
pattern could easily be adapted to NAEP usage because 
of the grouping of exercises according to educational 
objectives. 

There are strono intercorrelations among the 
Items in each of the first two aroups , but smaller 
correlations between items in the first group and 
Items in the second group. The inference is that 
there is a lot of freedom of choice among items to 
represent each class, but that both classes should be 
represented. Within each class a few items (as long 
as they are in any sense reasonable choices) will ac- 
count for a Significant part of the variance but 
addina iters will produce smaller and smaller incre- 
m.ents of explained variance .io that relatively few 
(less than a hali'-dozen) ite-ns in each cateaory will 
explain essentivL.ly all of the variance explainable 
by that category of item, 

A study by RTI (4 3) investiaated the response 
errors inherent in asking pupils about the occupations 
of their parents, their educational attainment, and the 
Items in their homes. Pupil responses were compared 
with parental responses. When three cateaories of 
occupation and three cateaories of educational attain- 
m.ent were used it was found that percent consistency 
ranged from 52 percent for the lowest class of 
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rather 's occupation to 85 percent for the lowest 
class of mother's occupation, and from 41 percent for 
fathers who did not Graduate fron high school to 76 
percent for rr.others who are college graduates. The 
results are for eiahth-arade students. Results were 
sorewha*: poorer for third grade. Surprisingly, con- 
sistency between parents and pupils was lower for ed- 
ucational attainment than for occupational status. 

However, consisvericy was relatively high for 
quest i(?ns concerning items in the home, beina 90 per- 
cent or better for television set, telephone, record 
player ''hi-fi/stereo , re f riaerator , automobile and 
vacuum cleaner for both third and eiahth arade. 
Certain items have m.ore discriminatinc? power than 
others, however, by virtue of the fact that they are 
ov;ned by a sm.aller proportion of the population. 
Fncyclopedia , daily newspaper, macrazine subscriptions, 
vacuum cleaner, and number of books tend to be of this 
nature. The RTI results are worth careful examination 
prior to implementation of any extensive collection of 
Srs indicators . 



4.2 Sex 

Sex has differential explanatory power depend 
ina upon the aae aroup and out.com.es studies. There 
appears to be no reason why sex should not continue 
to bo recorded. 



4 • 3 Race 

Race is hicihly correlated with m.easures of SES, 
However, the principal studies have shown that there 
is an additional contribution to the explanation of 
variance beyond that which can be attributed to SFS. 
This is particularly true among young adult job exper 
ionces, and especially so for women. There is evi- 
dence of substantial differences am.ong the non-Black 
ethnic minorities such as Mexican-Americans, American 
Tn.lians, ;^uerto Ricans and Orientals. Cven though 
rovresentat ion of some of these is sm.all in the NAEP 
sample, there appears to be sufficient evidence for 
consi :leration of separate recording of them. 
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4.4 Ability 

Trwiditicnally , ability has been considered a 
ra jor rredictoi- of educational outcomes • The major 
studies \<e have exarined show that much of the abil- 
ity reasure is accounted for by SFS and other back- 
urcvind factors. There still remains some additional 
contribution ability, however. Difficult problems 
cf roasuror/.ent ray make it impractical to consider 
ai;ility as a background variable for the National 
A s s o s sr.on t application. 



4.5 School Factors 

The Culer.'.dn study (5) was aimed primarily at ob- 
serving differerces arona schools and relatina those 
differences to educational outcomes. The literature 
is full cf evidence that school differences, as mea- 
sured by averaoG SES of students, racial mix of 
students, and various characteristics of the school 
and the teachinc staff, are im.portant in explaining 
differences in education outcomes. However, most 
cf those differences ca*^. be accounted for by differ- 
ences in student backaround characteristics because 
of the hich correlation between school characteristics 
and pupil characteristics. This had led some authors 
to conclude that schools do not make a difference, 
but one perhaps could also araue that, aiven the 
characteristics of the school, the backarounds of 
the students dc not make a difference. The point is 
that student backaround and school characteristics 
arc interlocked and toaethcr they account for a sub- 
stantial portion of variance in student outcomes. 



4.6 Motivation, Attitude, Expectation and Other 

Measures 

A number cf intermediate variables (i.e., 
interrediatt^ between tho fixed backaround of the 
put i i and --is educational achievement) have been shown 
tc ha'.'o an effect on educational outcomes. The inter- 
f.'rotation of" these measures as backaround variables is 
.su:.-^Ov-t to the criticism that tJiey, themselves, are at 
le.ist partially an outcor^e of the educational process, 
an.: t::it all are non trivially correlated with SFS and 
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ability. If thoy are to bo considered in the educa 
tional'r>odel the evidence is that far.ily relations, 
self-concept of school ability, ambitions, job 
attitudes, and plans for further education are im- 
portant variables. The r.ethod of path coefficients 
used by Duncan et al. (47) Hauser, (21) and others 
provides a particularly rich methodology for the 
analysis of intermediate variables. 
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CHAMTR 5 
KPILOGUE 



5.1 introduction 

Ono of the Bncjciostions that came from the dis- 
cuss.ion of the initLil draft of this report with a 
review panel (r,oo Preface for membcjrship) was that we 
prepare an cpiloque to the report. The epiloque would 
be a brief sununary of impressions and recommendations 
that could qo beyond what wo felt free to do in the 
main text of the report, i.e., the simple summariza- 
tion of the influence of background variables aa seen 
in the literature. We have also developed some per- 
spective on the principal studies that have been used 
to show associations between backcfround and educational 
outcomes, and wo would like to present some general- 
izations about such studies and the need for further 
study. Finally, the process of measuring background 
variables, and of measuring association, requires 
some further comment. These considerations, together 
with the suggestions from the review panel, have mo- 
tivated us to write this chapter, which is not nec- 
essarily encompassed within '.he scope of the contract 
but which wo feel may permit the reader to benefit 
more fully from our experience in accomplishing the 
literature review. 

Throughout this report the views expressed are 
those of the authors and do not necessarily represent 
those of NAKP, This caution is particularly relevant 
to this chapter. 



5.2 Methodology for Estimating Association 

Percent of explained variance was chosen as the 
principal measure of association in this study partly 
because it appears so frequently in the literature. 
It is also a particularly effective measure since it 
is scale-free and relatively easy to compute. 

_ It is by no means necessary to use linear re- 
gression in the computation of percent of variance 
explained by background factors, although the tech- 
nique has been widely used. One could form mutually 
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Black frnuib^s, 33, livino in urban aroas in the 
Northoabt, with paronts in unt^kilJod occupations ami 
with lcs*5 than hiuh i^chool education # otc. 

Any tOHtod child would fall into one and only one such 
i^\ilHtroupi and tho b<nmdnric^s of the Hub<troups could be 
sot i?o that i*omo niinir.utni nuinbor of samplo cases was 
in tnioh, Thun the ostimatcd percent of variation 
accounted for could bo estimated and tested for sig- 
nificance by the usual methods of analysis of variance. 
In some ways^ this kind of analysis has much to recom- 
mend it since it makes no assumption about relation- 
ships -unoncf the backsiround variables. It is feasible 
in this framework to identify population subgroups 
whose performance and proqress can be mcasurc.d over 
timCt 

The analysis is not satisfyinci to some, however, 
because it does not permit one to say how mvich of the 
variation is "due to" education of parents, or occupa- 
tion of parents, or type of community, etc^ Regres- 
sion analysis avrear^o to do just that, but the 
appearance is deceiving. If one uses a single back- 
ground variable he may "account for" (say) 10 percent 
of the variance in the criterion. Another variable 
may account for 8 percent and the two together (say) 
14 percent. Apparently, the first adds 6 percentage 
joints to the explanation by the second and the second 
adds 4 percetitages points to the explanation by the 
first ♦ But the situation may change substantially as 
soon as another variable is added. Mayeske and others 
have made useful attempts to identify unique contribu- 
tions to variance of a set of variables. Nevertheless, 
as they fully recognize, what appear to be unique con- 
tributions of each variable are only unique with re- 
spect to the particular subset chosen and with respect 
to the linearity and additivity assumptions inherent 
in the regression model. Addition of variables re- 
duces the so-called unique contributions and may in- 
creasingly call into question any assumption that the 
effects of the background variables are additive. 
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lu'ivo conhUviorable mvit in tu^^vincj NAKI^'s analytical 

abJoL? haa boon ruulo tlu^ro ivny Ix,-* advantnuoH in niakina 
vnM-.porisons^ urour t>y cjroup ratlior than in makinq com- 
parip.ons or' awljuutcvi outw^an'CM-^ » Wo belicn^-:? this? less 
iKiphiiUuv^atod ai.'proach to analyyis^ it? more cnliahton- 
iruj to tlw extent that it i^^ foaHxblu. Howovo;/ tho 
«ii*os or tho aroupt.^ boeomo a proJ^lom, and one may then 
noovi to royort to aajustmont in an offort to make 
awrawfo or ovor-all oomparisons in which some of tho 
oit'octB o£ asi:uciatod variables have been removed. 

Statistical adjustment i^ frequently undertaken 
to answer luioh questions as "How much (if' any) would 
outcuMV.CB in tho South be different from tho national 
:M.'oraac if the South had the same averacto wMFS as the 
entire nation, the sane racial distribution, tho same 
schools, tho same family size and composition, and so 
on?" The answer to the question is (hopefully) a 
measure of "tho Southern effect," whatever that means. 
Althoucth much of the literature warns against inter- 
pretation of differences in background as "causes" 
of differences in outcomes (and wo have repeatedly 
done so in this report) there is a tendency to do so 
and, in this example, to say (incorrectly) that resi- 
dence in the South "causes" the adjusted difference 
from the national average. 

Quite aside from the matter of improper attri- 
bution of cause is the problem of the measurement 
itself. Adjustment requires assumptions about a model 
and, for computational convenience, the model that 
usually in assumed is one of a linear combination of 
separate background effects. There is abundant evi- 
dence in the literature we have studied that such an 
additive linear model is not a good one and that, in 
fact, almost every background factor is correlated 
with every other background factor so that, at least, 
the most important interacti ms should be built into 
the adjustment model. This could easily be done with 
modern computing machinery. 

In any case, the observed differences after ad- 
justment are presumably more nearly comparable than 
they were before. That is, the adjustm.ent process 
will partially correct for factors which otherwise 
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would bias? the oon.i^Ku^ison . Tho amount of th^ cor- 
rGC^tion is hicihly tkpcndont upon the vnlilit-v of tho 
model, but ovt>n an ill^fittinn n^^dol may n.ako tho data 
moro comparable than thuy wore? prior to aa jui^tment • 

The apparent ^mnll maonitutios of explained 
varicmce reported in the study may be of some ooncorn 
to the reader. After all, if 20 pi^nrcent of the vari- 
ation in the criterion is accounted for by a ciivcn sot 
of variables then 80 percent must be unaccmmted for, 
and that seems to be the dominant fact. One must re- 
meinl)er that prediction is not the objective improved 
comparability is, Accountinn for 20 percent of the 
total variation by classification (as above) or by 
rearession or other adjustment procedures car; add sub- 
stantially to the interpretation of comparisons • 

Tew of the studios we have examined have paid 
any attention to the errors and especially the biases 
in estimation of the percent of explained variance • 
The California studies (4) didt The least-squares 
method of f J luting regressions assures a minimum resi- 
dual sum of squares "(by definition) and hence a maximum 
of explained variation ,'"ov the cot of oar>^:'lc data tc 
\:hi.:}h It ic arrli^^t. It will not fit another sample 
from the same' population so well, hence it overstates 
tho variation explained by the "independent" variables^ 
The overstatement increases as the sample size de- 
creases and as the number of variables increases since 
the fitted regression, under these circumstances, be- 
comes more and more a function of the particular sample 
values used. 

A simple way of testing the validity of regres- 
sions is to separate the sample into random halves, 
computing the regressions for each half independently 
and comparing the results. If some stability is evi- 
dent, then the combined data can be used for final 
estimates. The exercise is particularly relevant 
when one is attempting to choose the most important 
among a set of candidate backqround variables, and in 
estimating the proportion of explained variance. 
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Within x\hc ro.^oiu-co Jinifcation^ of thin Btudy it 
]\.u\ not boon poHiUblc to Uis^ouBj:^ the posaib-lo impact 
ei- ir.OviHuroinknit errors on the retiults of each study. 
In !''iu*t^ r.oHt of tho atiKlios have uivan little atten- 
tion to the matter. 

i'rrors in s?urvt^ys aro of two kincins (1) snm- 
plinvj orrovs or errors in coveraqo and (2) ornn^s in 
jnoaBurojuont . Krrort^ in covcrago can bo controlled 
within any pru^spc^ci fied linuts by incrcaHinq tho sample 
5i;;0i providod that tho sarnp.linci procedures are un- 
biayod and that royponsos are obtained from all sam- 
pUnvt unit.^. Tho first condition is frequently met 
and the second almost never. 

As tho rate of nonrosponso increases one worries 
more and more about the selectivity of those who do 
respond. Per example, students who are absent on the 
day of testincT may tend, more than average, to lack 
motivation, be from low-SPS families, be' in particular 
racial/ethnic t7roups, and so on and, what is of more 
concern, their knowledge that tostinq is to be done 
may influence their attendance adversely, particularly 
if their performance is likely to be poor. 

National Assessment emphasizes the importance 
of response rates, and that emphasis adds substantially 
to the quality of the assessment results. Most of the 
studies we have examined, however, are not explicit 
with respect to the procedures used to obtain response, 
although in at least half of them overall response 
rates are quoted. In general, it has not been possible 
for us to assess the impact of nonresponse on the re- 
sults cited, but the consistency in results among 
the major studies, where a variety of survey proce- 
dures was used, lends support to the assumption that 
nonresponse may have had only a modest impact on the 
principal results cited. 

The extent of errors in measurement, e.g., stu- 
dents marking their papers incorrectly when they in 
fact know the answer to a question, incorrect report- 
ing of parental education and occupation, incorrect 
reporting of items in the home, etc., are not ade- 
quately known and few of the studies have attempted 
any kind of validity assessment. An exception is 
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the NAKr**B{K>ru^i>rcil t^tnuly to examine the v4r7curocy with 
whieh sttuU-^ntiB report- 1 t-om^ in the homoi Q<?cuj>atMioh 
anU tKlucvition ot* paronts* 

It iiB a pecntliarity of jiuk.fing docirco ot; asi^oaia- 
tion by peroout of varianu-o oxplainovl that 3ar<td errors 
in relatively t'ow obs^crvatlons ccin have a major impact 
on the estimates, Thiss is particularly true when many 
"inilependent" variviblen are used or separate rcqros- 
sions are used for small classes. 

We know that errors of moasuroment decrease the 
anH)vmt of explained variance, perhaps substantially, 
but we have little evidence as to how much of such 
underestimation may have occurred in the major studies 
v;e examined. Also, adjustments designed to increase 
comparability of ctroups are likely to be underadjust- 
ments if there are measurement errors in the indepen- 
dent variables. Therefore the adjustments may leave 
differences unexplained that could have been explained 
by more accurate measurement. 



5,4 Limitations in the Interpretation of Relationships 
from Survey Data 

Throughout this report we have warned against 
inferring cause and effect from associations among 
variables, regardless of the strength of those 
associations. Inability to assign cause and effect 
is inherent in all analyses of survey data where 
there has been no opportunity to randomize the assign- 
ment of persons to treatment subgroups for which out- 
comes are to be measured. 

This limitation is of little consequence when 
outcome data are adjusted for fixed background charac- 
teristics (e,g., race, sex, family SFS, etc) in 
order to make subgroups more comparable with respect 
to the variables used in adjustment. It may be of 
major consequence, however, if cause and effect are 
attributed to association with intermediate variables 
and educational policy is set so as to improve out- 
comes by improving the intermediate variables. 
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NoMONpvnltwnt'al data, fmdi wit; have l)out) prosontocl 
■in ipi?: thi> istuuiiof? wo havn rr*vtow^j^r;i^ ctt^i jMrticul nrly 
i:^'-**- ttH?l>ive in tOBtiiKt hypothosofc^ ixhowt c?auBO. Krankol 
(It^) hari i.^rovivioa c/idonco of tho ap{>;iicabil.ity of 

j-.twitiistic?al lUstrAhufcion thoory to tu^Btn of hypothoHos 
in svu'voy data, but who roixl i'^^suos arc ooncornod with 
the pcni^ihlo validity oi:' altornato oaiu^al hvpothcsc^j^, 
Thi^ feiih^plo hypotlmsiB that lUack children perform as 
v:oll aH White children on standard roadinu tonts can 
bo auickly rojoctod^ Whoro the dif Ificul ties arise is 
in hvpothosos conccrninu the sonrco or cause of tho 
difjrVrcnco: Cultural or racial bias of tho tests? 
LMucational disadvantauo of tho homo onvironmont? 
equality of schools and instruction? Differences in 
ability to loarn? Differences in lanquaqe used in 
tho home and on the street? L-conomic deprivation of 
tho family? Number of siblinqs? Heredity or environ- 
ment (nature or nurture)? Recent interpretations of 
evidence on school effects, or lack of them, involve 
serious interpretation risks of this sort. 

Acceptance or rejection of any of these hypoth- 
eses requires assumptions about interrelationships 
among the variables which, themselves, arc incapable 
of test without assumptions about other relationships. 
Thus, the process is circular unless there has been 
randomized assignment of subjects to educational 
treatments. 

Fortunately, the unscrambling of such hypoth- 
eses, or the adjustment of data to increase compara- 
bility on certain independent variables, is not necess- 
iry to setting important aspects of educational 
policy — it would be helpful, of course. That cer- 
tain subgroups of uio population lag behind their 
peers in performance on measure? of achievement is a 
fact, and presumably NAFP's functions include the mea- 
surement of that gap and its monitoring over time. 
The extent of the gap may be used as an indicator of 
the need for funding or for focus on certain subgroups 
in setting educational policy. Proof of the effec- 
tiveness of the tactics of education, that is, the 
actual methods for bringing lagging subgroups up to a 
higher level of performance, cannot be expected to 
core from the examination of survey data. Such data 
can be helpful, but may not be sufficient. 
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5.5 Unit of Olnjorvation and Aiu\lysis 



TUo National A.^«Oi?Bniont adn^inisters relatively 
fow ONoroit^os in ;niy one asto ctroup in any one school, 
and t'cr this and other reasons s^chool performance 
nH:*aBures are never puMisf^hc'di Thus^ the interest of 
NAKP i^. entirely in the student, not the school^ as 
th,o unit of analysis for the dependent or outcome 
variables* However, there may be interest in school 
eluiraeteristics as independent or backciround variables 
that may account for some of the variability of the 
aependont or outcome variables. 

An important part of the literature treats the 
school (or school district) as the unit of analysib in 
analyzincT outcomes » Available background variables 
often represent either community characteristics such 
as measures of community income # racial composition > 
and so on, or averages of student-body characteris- 
tics — average occupational score and educational 
score of parents, percent of students who are Black, 
etc. Outcomes are average performance scores for the 
school (or for each grade or age group in the 
school ) • 

Such analyses with average outcome measures at 
the school level may be useful for performance mea- 
surement and goal-setting by schools and school dis- 
tricts, but they have only limited relevance to the 
objectives of NAEP. The possible impact of some 
student characteristics on individual student perform- 
ance tends to get obscured almost completely by this 
process* For example. Comber and Keeves (7) found 
a significant sex difference in science scores of 
high school seniors when the unit of analysis was the 
individual student, but, at least in public high 
schools in the United States, the sex distribution 
tends to be so even that the sex difference would 
not appear :n the differences among schools • 
Also, racial balancing of schools will tend to ob- 
scare racial differences even though those differences 
may be ascribed to SES or factors other than race 
itself . 

A final problem with using the school as the 
unit of analysis was pointed out in Section 1.3. 
When the school is the unit of analysis, the total 
variance to be explained is the total variance oTvcng 



190 



which is only one component of total '*arianca 
artona students » Explanation of. a certain pcrcentaae 
o{: bti)twccn-school wirianco is not readily interprdt- 
i\hl^ in torm of porcont of between*- student Variance* 

Howovor, using school characteristics as the 
uKit r.'\^^'>*V:rr for defminq student independent 
or background variables, and the student as the uK-f t 
for outcome variables can be useful both 
to NAKP and to the more general educational research 
community. Such uses have been common • The procedure 
creates an analytical record for each student which 
contains his individual scores, his individual charac- 
teristics and the school (or community) background 
codes percent Black, average income, etc. All 
students in a crivcn school would have the same coding 
of school and community background. This mode of 
analysis was used by Mayeske et al, (31), However, 
Mayeske's analysis frequently included both the in- 
dividual student characteristics and the average of 
them for the student body. As a result, many of the 
student-body characteristics showed little association 
beyond that shown by individual characteristics, 

A reanalysis of the data could be done to 
determine percentage of total individual-student vari- 
ance that could be accounted for by student-body 
characteristics. Such analyses could be important to 
NAKP because it is less costly (and sometimes more 
feasible politically) to obtain sone characteristics 
on a school-wide basis than individually from students. 
There might be a significant loss in the proportion of 
the total variance that could be accounted for by such 
variables unless they are variables that can only be 
measured at the school level such as school expendi- 
tures per student, etc, 

A further comment on unit of observation is that 
none of the large-scale studies we reviewed identified 
the individual characteristics of the teacher (or 
teachers) who taught the student whose score was the 
subject of analysis,^ Teacher scores (age, race, 
sex, degrees, scores on word-ability tests, etc,) 



This may be evidence of the "large-study bias" of 
the literature reviewed in this study* 
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v,'or?v^ a!w<iya avffjrv-iruuun) {or avorc\aos$) for tho school ♦ 
Otho^* School ospvu^icneoi^ oi' feho r>l.udt>nt tuiifht alao bo 
rolatod to the iiicii vi^Uunl studont. The opinion was^ 
t?»si>roi5.sir-n:i in our rov1<>w pcinol that school ef foots 
ir.icjht appear moro imvH^rtant if tho imUvidUv^I teacher^ 
aUvisor, curriouUuu^ and othor spocific school inputs 
!;or th.o particular istudont could havo boon associated 
with tht:> individual student scort>s. It was rocoqnizGdf 
h.owovor, that tho toachor characteristics havinq the 
cn;oat:o.-;t impact on studont scores (intcrost^ motiva- 
tion, "warmth") miyht be hard to moasuro, and the 
.%itU'Jont is influoncod by toachors ho has had in pro- 
viour. yoars. Also, while it is relatively easy to 
associate students uniquely with teachers in tho 
lower ctrades, it becomes incroasinijly difficult in 
intorv.ediate and hinh schools, whore there is more 
assiunncnt of teachers by subject matter. Still, the 
characteristics of the subject-matter teacher could be 
as^jociated with the studort's scores in that ^subject 
matter . 

In view of the amount of literature recently 
that has tended to discount the differential impact 
of schools and teachers, one can hope that eventually 
a research project can bo mounted to investicrate, on 
a reasonably large scale, the differential impact of 
teac!ierB and other school inputs on student performance. 



5.6 Large-Study Bias 

In this study we have intontionally selected the 
large-scale studies. Thes'=5 have tended to be national 
or international studies and as a result: 

• Certain population subgroups have tended not 
to receive special emphasis or identification 
(American Indian , Mexican-American, Chinese , 
etc . ) . 

• For the most part background characteristics 
have been selected that are presumed to have 
an impact for all population subgroups. 

• Intensive examination of student -parent-school 
relationships has not been an important ele- 
ment of most of these studies, although it 
has received some attention. 
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T!u5Sw» cor*soqm^n.?G>ri niwiy not bo important in mcotiny 
tho dbit?etivD^ of NAKI% but ro??r^archors« intorcstnd in 
pArticnilar suhctroup.^ or in rclatitMiBhip^si that Ccmnot 
\ o, obtaimnl easily by -itand: rUiaoii tcst?^ or quostion- 
nairoB will not find this study very satisfying* 



S.7 Background Adjustment of Longitudinal Data 

One of the motivations for adjustment of out- 
come data for backuiound variables ii; that thu coin** 
position of the sample will channc over timo, 
refloci:inq chancjes \u the economic, social, and ethnic 
characteristics of the population, Wi'.hout such ad- 
justment an apparent improvement miuht occur, for 
example, simply because proportionately fewer educa- 
tionally disadvuutacTcd persons were included in the 
population (and in the sample) in the current period 
than in the base period • 

Unfortunately, such adjustment may contain a 
trap thau is not easily recognizabl": • Suppose, for 
examtpl'e, that Si:;-; is measured by the number of appli- 
ances and educational items in the home (from a stan- 
dard list of such items) • An increase in average score 
from (say) seven items in the base period to (say) ten 
items in the current period does not necessarily mean 
that the SES of students is higher in the current 
period than in the bane period. In part, at least, 
SES is a relative concept, and as the general level 
of living increases the number of items in the home 
tends to increase. Possession of a television set in 
1973 hardly has the same meaning as pos;:ession of a 
television set in 1955. The problem is tnat the 
base used for adjustment may shift. Even characteris- 
tics such as rural, urban, and metropolitan, or geo- 
graphic division, may lack stability, although perhaps 
to a considerably lesser extent. 

There is no very good solution to this problem. 
One can, of course, attempt to normalize the scale of 
the background variables with respect to each year's 
assessment so that a student's SES score is always 
relative to the mean (let's say) of that year's 
assessment grOw . . It seems to us that this may be 
desirable for some analyses of relative performance 
rather than ab«?'^'^v.te performance. 
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tt may Uowovor# that tlu-^ varinblo ?.tB«?lf ha^r^ 
a .Ut't^ir/vnt r.it-^aninci (or iminiot) over tiv\o, Per ex*^ 
atrjiUs tho Colenuin .^tudy was done prior to the ox- 
toni.?ivu otfortB to baUmco school cnirol Inionts by raco. 
rt Boon^.?^ \in.Ukc»ly thvit tho sohool ch.iractori.stie 
"70 pcrvtent Hlciok*' hc\$ the t^aru** monninq now as it 
hvKi in tho nndJlo 1^50 'j^. NornMli'^inq tho ?ichool 
j5t:iU*t> rolativo to tht"* distribution of pnrcont Plack ifj 
only a {>artial isolation booaur^o n>irrowinu tho dis^tri- 
but ion cM- poi\^ont Hlaok by businu and rc^nl itnmcnt of 
attondanc?e areas will altr.ost certainly have vin iinpact 
or. the aB.^oeiation botwoon outcomes and percent 
Black in the Hchool. 



5.B Some Additional conmients and Uecommendntions 
Concernincj ChoiceB ot Back^jtound Variables for 

a. NAHP has approached the definition of vari- 
ables used for analysis and adjustment as thoucjh tho 
only comparisons? to be made are internal con^parisons 
within NAKP, both at one point in time and over time. 
Thus, NAI:P*s definition of size and type of community 
is unique to NAKP and not comparable with classifica- 
tions used by the Census Bureau or any other acjency 
sso far as ive are aware. However, NAHP is not action- 
oriented and one of its purposes is to provide infor- 
mation for general use and evaluation. Consequently, 
it seemB likely that the utility of NAt:P results woul.'^ 
be enhanced if more attention were qiven to tho choice 
of classifications so that NAKP results miqht be com- 
pared with information from other sources. 

Also, N-AEP now collects background information 
for use as classification or adjustment variables in 
presentina its test results. We sugqest that consid- 
eration be given to separate summarization and pub- 
lication of such background information. This would ^ 
have the advantage not only of providing socioeconomic 
measures of direct usefulness in describing the par- 
ticular populations covered by NADP, and for measuring 
changes in these populations, but also for the evalu- 
ation of the NAF.P sample. 
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b» We suvKjest tiuit NAKP should consider intro*- 
viucinu an SUS measure based on occupation and oduc.:^- 
tion of j:.aronts for lonqitudinal oojnparisonB t Items 
in the homo have advantages from the point of view of 
Uw^ta collection and should be collected for within- 
^idministration analyses ^ However, as pointed out 
onrlior, items in the home may be less adequate for 
measuring changes over time, a aoal in which NAB:P has 
a primary interest. 

Redundancy of information for an SES index 
appears desirable because of problemts of unreliability 
of response on an individual measure and because of 
partial nonresponse on tail-sheet (i,e., background) 
information . 

We have cjiven some attention to whether occupa- 
tional questions should be preceded into a few alter- 
nate categories , or whether free answers should be 
obtained, to be coded subsequently when the returns 
are received. Contradictory opinions were expressed 
on this matter in the review of this report by the 
panel of experts, and we have not seen adequate evi- 
dence to make a specific recommendation, especially 
for the NAEP age gr^»ups . We tentatively recommend 
the check-box approach but urge some additional 
research directed at this question. 

Another approach for an SES index is to obtain 
address information from the student, code the ad- 
dresses to Census small areas, and obtain Census 
community measures of SES that might be assigned on 
a small-area basis. This approach deserves further 
exploration. It may be more useful in metropolitan 
areas than elsewhere , 

c* School variables of two types could be ob- 
tained by NAEP at modest coEt, without substantially 
increasing the reporting load. School variables have 
not proved to account for important parts of total var- 
iance of individual student achievement-test scores 
in the studies we have examined, but their contribu- 
tion has not been inconsequential. Also, there is 
reason to believe that such variables might be more 
effective in accounting for change in achievement over 
tine than in accounting for variations in level of 
achievement at a point in time. We believe this sub- 
ject deserves attention, and that such variables 
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miciht he u{'fc>ot :lv^> fox* NARP uso. Also, within-school 
varialvleB, eBpc»cially characteristics of the teachers 
•n individual r^tudt^nts, particular coursea taken by 
the student, ctrados, and even earlier achievement- 
test i^coros iv.iaht feasibly be collected through the 
;K'hoolti, and explored for analytical use. Such infer 
:.jation could be obtained without addina to the burden 
on the student, but the schools miqht have to be re- 
iinbursed for the cost of providing such information, 

d. We urge that NAEP consider exploring the 
utility of a few additional questions on the tail 
sh.oet pos^sibly questions such as occupational as- 
pirations and future educational intentions. Such 
questions seeip useful within the NAEP environment, 
and wo believe this area deserves more attention and 
possibly some experimental studies. Another back- 
ground variable that may be particularly worthwhile 
exploring is mobility of the student possibly 
whether he lived in the same house, and also in the 
saire county, a year ago, and five years ago, 

e. We believe that NAEP can usefully do experi 
mental work of two typf?s: (1) special studies out- 
side of the NAEP operation, and (2) some types of 
experimental studies incorporated within the ongoing 
>:aep operation. The latter should be done only after 
at least limited experimental exploration, 

f. We would like to see more attention to eval 
uation studies than we have seen in NAEP, This is a 
recommendation we made in an earlier study, ^ and we 
shall not repeat the recommendations here, but we 
believe that additional attention in this area would 
be highly desirable, 

g. A literature review such as we have done is 
rather unrewardina unless it is used to avoid relearn 
ing things that have already been learned, or is used 
to guide future work. We urcre , in this connection,* 
that while the literature review can serve these 



"National Assessment Design Implications" by Morris 
H, Hansen and Edward C, Bryant, presented at the 
December 1972 meetings of the American Association 
for the Advancement of Science, Washington, D.C, 
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purposes effectively NAEP should not limit considera- 
tion of background information to what has been en- 
countered in the literature review. We believe that 
coniron sense, judament, and experimental studies should 
have a strong additional role in guiding NAEP, 

5.9 Some Additional Suggestions for Research 

This literature review was intended to be one 
upon which some action can be taken, that is, the 
choice of a preliminary set of background factors 
(although feasibility of data collection and advis- 
ability of doing so were specifically not a part of 
the project). We believe that the basic objective of 
the study has been met, but the study may raise more 
issues than it resolves. We have made some recommen- 
dations here that seem important to us if the associa- 
tion between background factors and educational 
outcomes is to be better understood and measured. 

We suggest two models that may be useful for 
analytical purposes. Such models would partition the 
total sum of squares among student scores into the 
following components separately for White, Black, and 
other races: 

Model I 

Among school means 

Due to^^-s-cHool variables ' 
Due to school and community ' ' 

variables 

School residual ^ 



Among students within schools 
Due to farily background 
Due to family background and 

student-parent relationships 
Due to family background, student- 
parent relationships and student 
affective states 
Student residual 
Total 
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Model II 



Due to family background 

Due to family background and school 

Due to family background, school and 

individv.al teacher 
Due to family background, school, 

teacher and student-parent 

relationships -.p-^— . 

Due tc family background, school, 
teacher, student-parent 
relationships and student 

affective states . 

Residual 

Total 

The student is the unit of analysis in both 
models. The purpose of Model I is analytical, that is, 
to determine how much of the among-school variance can 
be accounted for by school and community variables 
and how much of the within-school variance can be 
accounted for by student-related characteristics. 
From this analysis conclusions could be drawn con-^ 
earning the amount of adjustment one could accomplish 
by using only school and community characteristics 
v;hich are inexpensive to gather compared to charac- 
teristics of individual students and their families. 

Model II orders the analysis in a way that might 
be useful to NAEP. "Family background" includes SES, 
family size, education of parents and similar variables. 
It is that set of variables that is not influenced 
to any major extent by school policy, funding, or 
teaching methods. The next variable added is "school, 
including resources, teaching staff, and similar items • 
A large increment in explained variance might provide 
a positive answer to the question: "Do schools make 
a difference?" Introduction of the individual teach- 
ers associated with the student, both in current and 
prior years, might provide an answer to the question: 
"Do teachers make a difference?" 

Adding the last two variables, student-parent re- 
lationships and student affective states have less 
relevance to near-term educational policy, but the 
amount of variance explained by them might have rele- 
vance to broader-range social policy. 



198 



We know of no past study that would provide the 
basis for complete analysis under these models al- 
though the Coleman data, as refined by Mayeske, would 
provide all but the individual -teacher data. 

Secondly, we would like to see an analysis of 
the percent of variation in student scores that can 
be accounted for by: (1) individual-student charac- 
teristics and family characteristics readily obtain- 
able fron students, (2) school characteristics, (3) 
teacher char^icteristics (for the specific classroom 
toacher or the specific subject-matter teacher) , and 
(4) community variables available from secondary 
sources. An exploratory study could be carried out 
with and without the more sensitive questions cibout 
parents. Such a study would show how much potential 
for adjustrrent, if any, is lost by substituting 
conu-.unity SES measures for individual-family SES 
measures, \ 
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